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2.2 



1.25 



1.4 
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titled "Gjjjess and tWit is a process that consist^ of at least the 

$ "■ •■ .: ' ... " • > >■ 

following steps: ' ^ * 

1 . Make a guess . ^ • w. - 

f ' • . >' " 

, 1. Check the guess. . ^ . , , ' >>■ 

3. Use the first guess\o make a better guess.* , V 

4. Repeat 4-3. ' > ^jj":' 

.This\strategy was sel^d/by MPSP asvthe first. one to use fpr testtng 
the feasibility of developing ins.tl-uctidna1 materials- to teach ir^oblem-'' 
"solving strat^egies) The process, given above is not described in-tK^ 
teachers' bookl^ In an attempt tg. deteriliine, whether this process was. 
evident in the module, the Trial^II teachers werfe asked during'individual 
erviews (1) what they perceived to be the objective of W4* module and 
(2) if the rnat^ials were congruent witTi that i^jective. 
: . ^ Jrfcst of the teachers -identified the objective of the modu"(^e td be^ ' 

a process similar *o one given above. jThe-se.^ame- teachers il so 
^ felt. that the process was present in the in|tructional boo.klQt., Ho"i^ 
ever, thfy^did f|el it was necessary to icl^ntify that process for the 
studiffnts and continaa>ly reinforce its use throughout the'experfences 
- wfth the pro^em deck. . ^ T« . . f 

^11- Problem card selections . Tables 12, 13, and 14 were " ' ' 

r ^- '. » 

developed for the purpose of identifying trends in the problem card 
selections. The following observations- seem most salient with respect 
. to the- selections. , - 




Jable 12 ' , s • 

1. The mu'ltiple-conditi6n..problem^ (V) Were attempted least in'^th 
. trials among the^fou'r problem, types. ''0-" / ^ 



'2. The green multipl<e-condit>Qn problems (V) were attempted vlast in both 

' * ^ • ■ ' ^ 

; ^ trials among the fouV problem types at each level 'oif d'tf/icultyO' 

3.: The diagram (D). and meai^rement (M)|probl ems were jatt^^^ ' ' 

frequently in -both trial s.^ The measuremeW problems in Trial I 
were attempt^/a much -greater number^ of times ihan the other problem 

.^types. -Jh,i^ is onterestingjsi nee the. measurement' lesson was the 
least popular ori6 according to teacher repo'rtYT- ^ . - ' 

Table 13 . - ' 



4. For both trials the perceht'of the tota(Qiumbe»yof' probl ems attempted 
Jor eachss-problemit^ is very cloFSg to .the p^rfent o> the total prob- 
lems available .in the deck of that type.v . ' • |C 
• Nea^^/.half of .the problems attempted during Jrial^l' are at the Blue'- 
(easiest) leVel of difficulty. . ■ ' ' ^ 



TAb^e 14 ' 

1 1 

.4* 



6. For Trial ^I, as the level of difficulty. fjncreases, the percent of 
the Wobl ems .rated hard incra^ses.^ FoT Trial II, the white prob- 
lems^werfe rated the most difficult; ' klhenUhe results for b|)th trial s 

■ are combined, th'e gre6n. problems, wp>.e rated the hardest followed by 
thewHite cards, /fToF^thes^r^ ones as one would expect." ' 

7. The Tr4al I students rate,d a, higher percentage of the pr;dblem^ 
J'hard," than dii) the ■ Tnal :I I students, 1^is observation in Ta^e 14 
is supported by the verbal feedbaclj^from th^tea<;hers that the^prob-" 

•) 1 ems in th.e .deck seemed difficult for the students. teachers in 
. Trial " II did not mention that 'the pf'oblems in the deck appeared to ' 

b6 too di.fficu^ for the students. The numbers of teachers .at each 
_ gra^e" level \qjrejyery similar^r botiT trials'. / ' 

8. The p^rcep-tagls (>f problem? railed as "liked" for each problem type 
are nearly the san^e. • . • ■ ■ ^ ^ 




The data in this section related -to the organization Snd content of 
/ tfie module was grouped into three categories: (1 ). editor ijaJl changes, 
(•2) objectives of the module, and (3) probldm^ard selections. The 
data analysis in this isection suggests the following recommendations/ 
^coritients. related to the ortian^zation and content of the module (speci - 
fldiTly, the onfe used for-/th^ second 

Instructional Booklet • • ' . 



1 



2. 

-/ 



A discussion concerning the role of ''Guess and Test" In problem 
isoTving should be included jS^he' teacher 's booklet or premodule^ 
ictivities. • \ . 

The "overview^" of ^^ch lesson should relate the objective of that 
lesson to the overall objective^ 1 .eT, the "Gq^ss and Test" strategy, 
3." it appears that the teachers that used this module were able to 
identify for the most part the^ "Guess and Test" process In •the 
booklet. Ttiose same teachers* mentioned that they found it necessary 
jtq continually review that process while the students were soTvIng 
the problems In the deck. Since all the teachers did not -identify 
'this process, a detailed discussion of the "GUess ai^d Test" strategy 



should. be included. This recommendation is closely relaied^to^ 
nurtber one. 



4. Nec 

\ 



n bej: one 
a/ly all 



fonpat of the booklet 
The 



» Tri 
\^^oblem 



e: The 



of the teachers were satisfied with the content and 



teacKer^ notes were^uite appropriate for tfte teachers in 



Deck 



alphameric code on tfie problem cards should 'be explained in 



the teacher's booklet. 



Table 12 

Total Number of Problems Attempted by Students- 
at Each Lfeverpf Difficulty and Problem Type ' 







Trial I (N=5 classes)* 




V 


Difficultv 
Level? 




Problem Type 




1 




D • 


M 


V 


•total 


'blue ' 


•229(4)^ 


- 367(6) - 


- 473(9) 


208(4) . 


1277(23) 


yellow 


.114(9) 


84(6)• 


180(8) 


' ^' \y.K 




whitie 


]^32(10) 


.110 (8 J 


127.(8) 


64(5) " 


433(31) 


re^ ' ■ 


.92f5^_ 


'*63(8) • 


98(9) 


•64(6). , 


317(32) 


green 


eer?) 


42(5) 


71(7) 


'36(5) -X 


"215(24) 


Total / " 


633(41 ) 


^ 666(38) 


;949(33) 


"5 

519(28) 


•'2767(133) 



Trial II #(^=5 cl asses )b 



blue 

y.elfow 

white 

red 

green* 



.97(4) 


218(6) _ 


204 C9) 


^(|) 


79(9) 


. l07(6)-^» ■ 


-10§(8)' 


. 99(8) 


133(^0). 


49(8) ~ 


73(8) 


46(5) 


68(9) 


82(8) 


\ 79(9.) \ 


^:89(6) 


?5(7) 


.59(5.) 

' ! , L 


28^7) / 


•12>5). 




515(39) 


490(33) , 


295 (^ 



>577(?3) 
38€(31') 

S 

301 (31 ) 
318(32) 



Total 

— r 



via 5* ' .'•■■«'/■ 

- Total pumber of problems, available at each level. - ' • 

^ Ha-lf of all the data for one cl^iss' ir^ Triar II was^T5«§t for 
that Trial . ' . '\ 



Table 13 

Percent \of Total Number of Problems Attempted 
for Each Difficult^ Level and Problem Type 







Trial 


I - ' 






Dlfficul ty 




Problem Type 






Level 


C 


D 


M 


V 


Total 




8(2)^ 


13(5) 


17(7) 
. 7(6) 


8(3) 


46(17) 


yellow 


4(7) 


3(5) 


5(^6) 


19(24). 


.white ' 


5(8). 


4(6) 


5(6) 


2(4) 


- 16(24)' 


, red 


3(7) 


2(6) 


4(7) 


2(5) 


11(25) 


green • 


2(5) 


2,(4) ;' 


3(5)" - 


1(4.)- 


„ 8(18)' 


.Total 


22(29) • 


24(26) 


'36(31) 

V- 


(8(22) 


, 1^0(1 08 >^ 



Triar It 



1 blue 
• yel 1 ow 
white 
red 
green 



' 6(2) 
5(7) 
8(8) 
4(7) 
.1(5) 



13(5) 

5(6) 
^(4) 



,12(7) 
6(6) 

. 4(6) 
5(7) 
2(5) 



3(3) 

« 

•5(6) 

^(8); 

5(5) 
1(4) 



. 34(17) 
22(24) 

' J 8^24) 
19(25) 
7(18) 





29(31) . 17(22) 



Total 



24,(29) 30(26) 



Greater than '100 

♦ 



100(108) 



Percent of total; problems available at each level 
due to round irrj error. ^ 




loi 



' . Table 14 

Percent of Problems Rated as Hard and -Dill iked 
at Each Level of difficulty and Problem \Type 



Trial -I 



Difficulty 


s 


Problem TvDe> 






Level 


G . 


D 


. M 


y . 


Total 


blue 
yellow . 
white 
red 
green 


10,14a 
11,10 
12,14 
22,13 
J8,23 


l5,14 
7,6' 
if, 12 - 
I3V1O 
24,24 


6,22 

8,7 
^16,13 
1'9,9 
39,21 , 


10 15 
- 5.12 

N 27,5/ 
42,22 ^ 


8', 9 
13,1-4 

20 v9 
-38,23 


Totel 


^.lsl5 - 


.14,13, • ' 

# * ' 


- r8 ,14 


19, ?4 

. ■ • / • ^ 


18,14 


♦ 


< i' 


T-rial II 









blue 
y el Tow 
white N 
red 
green 



5,7 
12,10 
14,11 
*'l'2,8. . 
14,9'" 



4,5 ' 

-13,17 1 
11,9 
4,7 
?4.,T? , 



2,3 
15,13^ /. - 

0,8'' 



5,3 

32l',17# 
. 20,13 
13,10 
' 17,0 - 



' .4,4 
Tl ,11* 
*22,11 
9 ,8 
•18,10 • 



To tail 


11,9 


-9,9- 




15,10 








'Total 








blue 


8,11, 


9,10 


/ 4,13 


8,9 


7,9 


yell6w 


12,10 


10,12 / 


^ 5,4 


13,15 


\ 10,10 i 


> white 


'13,13 


■ IMl / 


16,15 


16,15 


23,13 


red 


17,11 • 


■ 9 ,^y' ■ 


^ 12,9 


15,8 


15,9" 


green' 


, '31,16 


24,1/ 


20,15 ' 


30,11 


.28,17.' 


Total 


16,12 


12/12 


ir,io . 


■ 17,12 


15,11 



"a * ' ' / 

The first numbe>f indicates the percent^ students that indi- 
. cated that probT^s ir/ these categories were "hard", and the 

second number that th}ey V^ere "difficult". The percent rat§ti 

V.easy and "liked" ean be found by subtracting each of the I 

nCimbers respectivel/y from 100. 




1.02 



7. For/ each problem type, the percentages of problems rated 'as "liked" 

' \ . . ,. - ■■. . .. ..-^ 1 . V - ■ 

nearly the same. * . . ' V ^ ^ * 



Fon 
--are 



8. The specific difficulty ratings for the-white problems sh'ould be 
considered. Overall, these problems werie rated moi^^ dfffi cult than 
the rid .pK^Qblems. ^ . ' ^ ^ . ^ - . 

t. Effectiveness : ' ^ ' . ^ \^ 

i. . Teachter judgment . This section of the report will, be pri- 
marily concerned"vMth the data from -tl^mcidule quizzes- related to stu- 
dent performance. Stu^nt performance was assessed directly, through . ^ 
module quizzes-aaff indirectlj^ through col4ettive teacher judgment.. 
During the in-sfervice sessions and/or indiv4^u^ interviews the teacher^ 

7 • ■ I • : 

were asked what they believed to be the most Sucdfessful attributes of 

■1 ' ;. ■ * i ^ ■ . 

the module. Jhe following comments are a selection, of those rec^^ed 
from Triall I and II. ^ '^^ ^ 

{Trial I : ^ ^ ' ^ - 0 \ 

-^It made students think about^v«at\they jare reading and^analyze their i 

■■ '. . . ■ ^ , ■ ' ■ ^ 

^ thoughts. • 



^- The enthusiasm:and willingness of the st^qdents to tackle problems. 

- It made the students thfnK; * ^ . _ ^ 

r 

- It gave the students a willingness to guess. 

' . . - r • ' ^ 

- Pro bliem card fo^mat.' V - - V* 

■ Trjal I/I , - ' * ■ '* 

\ ^ - , ^ ■ . : : " - . . - . 

- rnide the kids think differently and realize there is frequently ' 
more thaji orje solution to a problem. ^ ' 

- Format of .the materials, that is, a bopkl-et followed by a problem ^l^clc^. 

- Attitudinftl gains. - ^ ^ . ' 

- Interesting problems. • (^^ ^ ' . 

- Students of all .ability leveTs found s44ccess with^the module. 



' • /Clearly, most of "the comments above are related ta dimensions.*of 

^ effectiyeness other t^^ student performance. "Some^i^^ 

reflated vrl the above comments are (irattiVudes, t2) /format of the ^ 

'niaterials, and (3) the appropriateness of the moduli 4or all •abtlity 
■ •• . ' • * ■ ^ 

^ levels. It^pears that thk module; may have ^ had a positive effect " 

on many different areas. / v. / 

^ ^ ■ Module quizzed. The modu 1 e 'qui zzes usey for the ' eva 1 lia - 
, tiGils were developecjjby the MPSP evYluation staff at Indiana with the 
assistance o'f one of the .module dev.elopers from the University of 
-Northern Iowa (UNI). • For Jrial I, six forms o; a quiz were adminrstered 
as -a. post-test only to 212 student^js*4fet p^^ 

(experfment^ group) and 7^ stydent^hat did participate (eontrb:i 
group). For Tr/ial -11, fouf- forms of a quiz were ^iliistered -as a : 
pretest - post-test to 225 studefits/ ''Control studehts. were not; u^^d 
for Trial II. ' • 



• .Four separaf- analyses of the quiz rej^ults are included In this 
section. -Tfie quiz i;esuTts were analyzed by objective and grade -'i' 
„:1evel: ■ - . • ,^ - ' 

^(1) for both tri^s cpnibined, ' 

(2) across trials, • , - 

(3) for "each trial separately, 
^> ^ C4) with reipect to the problem card selectio'nir ' 

A'specific criterionjeyel for. successful perfarmance was not established, 
Rather, the quiz results were examined forvany trends that suggested 
changes in the module. ^ J - •' • , 



!J °u o'^ga^ization and content, if was m'^ntioned that 

, the Tri^ir teachers foundVthe content of the module too difficult 
for low-ability students. In contrast, three teachers in Trialll 
(two fourth and one sixth) /commented that the material'was appropriate 
tor, all abiTity levels. / 



AC-. 

t ... . • 



\ ' f ' 100. 

\ci each of the four analyses the fifth-grade classes generally 
scored lower than thl fourth- ^d sixth-grad^ classes.' Although this 
trend is present^in tjte,classes involved jn both trials, it i^mosit 
obvious in Trial I ( s e eTJhyes 1 7 , 18, and 19). In an attertipt to^'identify 
. a cause for this trend, the scoHBs on the Stanford/Achievement JeSft^SAT) 
for each class were analyzed, v Table 15 shows thaf the mean scores for: 
(1/) the fourth- and fifth-grade cesses ^a^. quite, close for, both 
trials while the sixth-grades scores are the highest. 
,(2) Trial .1, tSe mean SAT spQre J'dr th^' fourth-gradfccs' (teachers 40, 

13, &.23J is 43.5 and^3.7 for the fifth-Vaders. \ 
(3) Vrial II, the mean SAT score for the' fourth-graders is 50.0jmd 



58.0 for the fifth- graders. 



-A 



(4) Trial I, the mean SAT score for the seven teachers is 49.6^and, 
^ for Trial 11,6.5.6*. ^ \ ' 



" TableT5 

* Mean M justed SAT^Scores for the" CI asses 
Us.eihin the An^yses of the Quizes/' 



\ 





^ ' T<ial I 




. \- 


Trial II 




- f 

a 


Teacher 
Number 


I, ■ ^ 
GradeV::|7 


Mean 
Adjusted 
SAT - 


\ 

Teacher 
Number 


Grade 


Mean 
- Adjusted 
SAT 




. 40 . 


3/4 


__a 


' 27 . 


4. 


50 




*13 


4- ' 


54^ 










' 23 




31 1 




■ L 






15 ' 


5 


58 


02 


^ ■ '5' 


* §2 




11 


. 5 


44 


- 04 


■ , 5 


54 


22 




26 \- 




/ 


"'f • 


* 


26 


■ ; >^ 




21 


6 


'72 . 




14 


6'. . " : 


72 


20 


\ 6 


' '90 




a Missing data. ' - 













Jh? SAT was administered at the beginning orf the sc^hool yJiFaFN 
one of the Summatiye evaluation instruments 'of MPSp. v i 



ERIC 



It/ 



i5 ,. 



... Thpse four dbservationr are refTected for the^ost part in th6 - 
quiz resuVts for the twcr trial s.''- With regard to l/e first bbserva- 
.tioh , the sixth 'grade performed, the highest in Trial II but scored •/ 
lower than. the /ourth-graders-f^Trial I -^(see Table 17j^ For observa- 
ana tl#eey Table 17 sh^i^ that the fij^h-graders in Trial I 




, SQor^d.lovyeK^^t fourth-graders by 1^.2 percentage points* while 

the difference i^or Trial II -is only 4s5.percentag^points, and tl\ ^ 

. fourth--grade mean^or' bo|h;trials are nearly the same (50.5 for Trfal 

;^.versus . 5^,9 . for triar-Il). .Tables is, and 19 sfeport the fourth . 

obsery^tibn in ^that the means for the Trial Tl classes are. generally 
. ^ . ' ■ ' .. 

. higl;ier .than the means 'from "Trial I 
■ \ / 
This .'analysis •con|:erning the observ^ trend in the perform'^nce 

. of the f if th-gr^ade students fees not d;rectly contribute to sugges- • 

tions for^revising ,this mocfule. ■ However, 'th& analysis does show that 

for the^e teachers tha^eat^ SAT scores for each grade appeal* to be. 

reflected in the performaiftce on. the module quiz.' Since on?' purpose ^ 

for developing the moduli quiz was to construct an evaluative instru- 

Lntv^o^accQmg^any ^e final version of the modul£, further analysis 

of a possible j-nteradtion 'between tlre^AT scores'and the scores on 

the module qi^iz woulct contr-ibUte to establ ishing the-Val itlity of the ' 



module quiz. The activities- required to carry out this recommendation 
were not performed by the MPSP evaluation staff due to the termination; 
of the project. • ' \ , , 

For both^trials combined, Table 16'sffows that the n]ean percent of 
^corr^ct solutions on all forms of the modtjl^e quiz for both ty:ials is 
;51'.0 percent. , ' : ^ .' , ■ , 



*• The fourth- and fifth-g'r^de students were administered different 
; tests for Trial 'I. 



The highest performa*nce wa% on the fir^t' objective related to 
' "cdmputatiori'* (71.6^) a^ the .lowest^ performance w . 
problem; on the qLii2 (30.0%). On all except one fdrm^of the quiz tbe . 



lastproBlem is a multiple-condition problem. However, -the type of 



muliti pi e-6onditi on problem that^was stslected for the *ast problems .; 
\^z\\^!X^T to only eight of the 28 multiple-condition prpblems.xn 
the deck. Also, these eight problems were attempted a tbtal -of 250 ;•• 
times which is oivly six percent of tH"? total aljtempts . the otlier 
hand, the items lised for objective two, multiple conditions, ■'.are^^imil 
to the majority* of multiple-condition problems in«||he deck.. Thes^e: ; 
)proble1ns make up 27 percent of* the total- number-'of"*probl ems; attetiipted.* 
TMrTserformance rela,ted to objective two v.was somewhat higher (47.8%) 
than the. performance, on tfie last pr^l ems (30.0%) . : 

- , ■ ' ; Tabre-.li&V.:' '^^^^^^^^^^ ' 

' . . Quiz Results by Objective f^arf^ Grade ' / 

- • Level for Bofh Trji aVs Cdmbi n^?d ' 



* 




- Grade 






Objective 


4 (N=171) 


, .5 (N==136) 


6'"(N=126) 

■ \ ■ ■ - ■ ■■ 


Mean 


Computation 

Multiple > 
Conditions 


. 75.6 

■ '50.6-^-J ■ 


.,-.•■67.0 

-38.1 ^ 


7^.3 

' 54.7 


71.6 
47.8 


D'^agrams 


48.9 . : 


'40.8 * 


:56.0 ' 


48.6 


Measurement 


. .54.2 


53.5 ' 


- ' ■ 6?. 8 


.56-.:6 


Solve a 
Problem Osing 
Gu^ss and Test 


36.8 


■ 27.5 


25.8 


30.0 


Mean 


53.2 


'"f 45.3 ' 


' 54.3 


.^1.0 



S'lnce'the problems us^d for the last items on the quizzes -are also 
for the most pcirt, multi pi e-J^ri,diti on problems. Table 16 shows that perr 
formance on all of .ther"m(/ltipie conditions" items was the lowest... .The 
section of this report on organization aiifid content (see 'Table T3}\shows 
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that the muUiple-condHipn vprpblems, wen^^tenpfecf tfte least rtjjmber 
,of times, in both- trfals. The data in Table 16,' together with the 
frequency, of card selections, suggests that the number of cards at- 
•Cempted is reflected in the performance on the quii?. This point wil' 

; be d.isc.ussed later in this section. <!■ 

, . ■■ . ■ .. ' , • ^ 

Across Tri»ls .. Table 17 shnws that. thP ppv^fnr-mance -of the Trial 
- • student^n the module quiz was higher than that of the Trial I stude 
■ - each grade level 'col lapsed. across objectives, 

■ - each objective coTlapsed across grade level, and • ' 

" thirteen of the 'fifteen meay^ 9: eacfi_ grade leveT^d oii3ecti"^ 
Although many reasons may-acco^/nt for these tr*fen?is, four possfble' 
•"^ reasons, are: (1) the ability "levels 'of the students, (2) the difficu 
of th^. quizzes, (3 )_ the effectivenibss of ^the revised 'module, and (4) 
. 'different teachers. An -analysis /of the v^ean SAPj-scores for the class< 
. in both trials shows that the mean for Trial II (65.6) . is higher than 
f the mean fot^ Trial I (49.6) (see Table VS). The quizzes u^ed'in Tria" 
> were developed bi<. analyzing those used for«Srial i. Therefore,- it is 
' ^. doubtful -fihaf/ the difficulty level was any less for the forms used in 
Trial II. ,With regard ^to reasons three and fouK/, it is. clearly not* 
>ossi1^le to determine the exact, coatributions of these , factors . In fefi 
•light of teachers' icomments discussed e^^rlier,' it ^eems reasonable' to 
attribute some of the. improvement in scores to jthe changes in' the 
module.- / 

For each tr ial .separately . Tables 1^ and 19 show the quiz result 

■ Y . ' " . V 

for eachjirial. For-the most part,' the^ends observed in these tabl 
are the same as those in Tables 16 and 17. The data rn Tabled 18 and 

, 1? IS besi interpreted with respect to the problem card selections. 

■ , '•^ ■ ■ ■ . ■ 

*■■'■■■. ,, , t "V -. . 



e 



r 



■\ 
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(\ • ' Per^efitwOf C^rect-An^ers on*'Q^z"2b' Across 

'"^ ,. . ' . • Trials and Bj^jGrade Level arid Objective • * " ^ 

• ■ ' — ■ r^}/ - ■ ; • r — ^ — \ > • / 

^ ^ y • > , Grade ' 
>i . V « r— T — n 



, -4 • ♦ I r'^ • • 6 Comb.ihed 

. . ■ . • H' . I — a I , ,1 ^ II ,1 .II 

• , Objective-^ (N=93) . (N=78) (N=6,5) (11=71) MN=54< - (N=76) (N=212) .(N=225). 





73.1 


• ■ C ^ 
78.3 

■; 


56.V3 


72.3 


f- 

' 66.1 


— 




65.2 ^ 






51.3- 


50.3. 


■ 37. 1 


\ 38.4 ^ 


•42.0 


^ 


61 . . 


' 43.6* 




0' 


, 43.4 


_ 5T.7 


30. t 


4i5'.2't" 


. 38.9 




64.5 


..'?7.5 ^ 




58. f 


J 52.-3 


^ 48.2'l^^ 


56.1 V 


' *52.4 




68.0 


52.9 * 


58.8- 


s \ 


26^ 


. 41 T8 


: 4.6 > 




^22!2. 




27.7 


h7.8 


36.2 , 


.. Mean 


50"^ 


^ -54.9 


35.3 


50.4 ' 






59.3 


43.4 > 


■ 54.9 / 



* I - Trial One; II ^ Trial Two 



' C - Computation :\ ' ■ ' ^ 

V Multiple Conditions • ' ^ • t 

D - Diagram 

M - Measurement v . • . ' i , 

S - Solve a problem using gufess and test 



ProMem card selections and quiz results . Table 18 shows the quiz 
results:' for Trial I at each grade level and objective, fj^e following 
observations can be noted from Table . 18: ^ \ 

(1) The fifth-grade means are less than the fourth- and si)Jth-grade 
means for eyery objective. ; j, 

(2) For all but oneoBjective at tfte fourth grade, the fourth- and sixth- 
xirade experimental mearTs are greater than the control means. 

(3) The mean for all grades is the lowest with respect to the probl.ems 
where the student must attempt to find a solution and show his/her 
work. 

(4) The mean score for all grades and objectives is 43.4. 
Observations 1^, 3, and 4 are consistent with the trends previoust^ dis- 
cussed when the results for^joth^trials were combined. Observation two 



ERIC- . - 



^ 'I ' - , Table 18 \ " " V ' 

Qui#Re suits by Objecti ve'afid" 
. . t Grade Level. for Trial I 



' ' ■■ Grade : ' ' . '. . ^ 



'(4 



AK- < ^^P-)- >=65 Exp.)' (N=54- Exp ) (N=212 fxl^' 

Objective ^iN=il 3- Con.), iN=^ Con:) .(ViaCoS.'J (N--/! ConV 

; — ^ — jt-. — — '■ — ^ ' / 

^•73. -1 (74,6)^. FF-r^^- 4) '^6.U^^5) 65.2<65 8)-^. 

V .51.3(4^.0) . ./.b(.4,7) ■ .42.0(37..). ' 43.6(3l3) ^ 

D / 43.4(35..3). 30.1 (34.3) 38.9(35.7) ^'37.5(36.2) 

• M . . 58.1(63.2) 48. 2(47. 4.) \52. 4(35. 5) 52.9(45.4). 
S 26.8b(8r.4) ' 4.6(18.2) . 22.^^.5) 17. 904. 0) 

' . •4'3^5(-)C 34.2(30.7) 46.3(44.lV ^ . 41 .3C37.9) • 

, ■ 5p.4(70.'2) 59. 8(49.0)' 3L.5(4a.5^) .■47.2(53.2.) 

Mean 



50.-5(43.5)d 35.3(39.6) .44.3(36.7) ^ 43.4 (39.9) 

^ I!;f.rJ?n^^^'" P^^entlteses indicates- the mean pe^^ent of corr-ect 
, solutions for the control students. - " uurreci 

•* I5rn!i'"^I 11!"'^^'' ''^ P^'^""* °^ correct answers, the 

' If 12 ^i^e.mean percent of responses that maintained sonte 
of the conditions, and the third is the mean percent of 
Sem" ^ "^'"^ maintafn any of the conditions in the ' 

C • ' 

This item was not a multiple-condition problem - ' 

d ■ ■ ■ ■ ■ ■■ -X^^ 

' ■ * Sed"'?o"cafn^fJL°fh-°''''* responses on -the ^st item was 
usea to calculate this mean. i 

is interestingv: Even though the mean performance for the fourth "^^^^^-^ 
si^th-graders is le^ than 50 percent, the experimental student' 
f prmed- baiter than the control studerlts. ■ 

Table 19 shows the quiz- results at feach. grade level and objeci^ve 
for Trial II plus the mean gain in percent from the pretest to post-/ * 
test. The following observations seem most relevant from this table.' . 4S 
(1) There were gains from prjetest . to post-test for each grade and 



each objective with the exception of the 5th grade with objectiv 
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(2) The fifth-grade means are less than. the fourt^h- and sixth-grade 

means for most of the objectives. ■ ■ ' " \ ^ 

- . V •-. ^ '^^ . v ■ • . V . , 

(3) The ihean percent ^f ciflrrect answers for solving problems usinq 
.5ues5 and test is lowest for grades ^fojL^^and six and next to the 

lowe|MJi>^ade five. ^ ^ . 

(4) For grades four and ^>x, tHe^ greatest ^ain v^is'Yar the -"diagram" 
proulems.- ^ ' 

(5) For grade five, th^e greatest gain was on the ifem where they had 
to solve the problem(s). ' " • 

(6) The least gain was for the. multiple condition items ^t gra'des 
four and five and for the correct solution to the "'solve a 

'problem..." items at grade six. ' 

, (7.) The highest -mean Vt each grade level is" for the "computa,tion" 

' , ^ • . . * ' '\ ■ 

,i terns . - . ' - 

. . ■ »■ 

(«) The mean performance for all grades and forms of the quiz ranges ^' - 
_ from 48.9 to, 59.3 percent, 

The data in Table 20 suggests that for Trial I, there is. not a - 
strong relationship between the average total number of pr9bl ems * 
attempted by each student and performance on the quiz, nor between 
the total amount of time spent with the deck-and performance on the quiz. 
Also, a strong relationship does not appear to exist between the average 
number of problems attempted by each|Student at each level of difficulty' 
and performance on the quiz. 

■ y ' ^ 



A rank-order correlation coefficient was used to suggest trends in 
the data. * 
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Table. 19 

Pey:cent of Corr*fect Answers by'. 
Grade, Form, and Objective • 

. ^; — ^ ■ 



Fourth Grade 



■ ./ ' >Form>rM8) _ ( Forrt C(N=40) ' 
Objective Post-Test^" Gain t^ost-T^s-t. — Gain 



PastTfgit 



lean? v 



Gain 



r > 



c 

V 

D 
M 
S 



83.3 
45.6 
49.1 
58.8 
^1.1 



b ^ 



13.3 
' .1 .4 
20.1' 
12.9 
-8,6 



73.3 
"55*0 
5*4.2 
445.8 



t 6 .)s. - 
17.2V 
3.3 

11.9-, 



,■8.3 
^^0.3 
43.4 
5&.1/ 
26.8 



I 4.0 
31 .8 
8.1 
' 10.3-^ 



Mean 


51.6' ■' 




' 1 

' 58.2 


, 9.6 


51.4 ' 


' 13.-1 


f Fi fth Grade ■ . . 


Objective 


Form 5(N=35) 


Wm C(N=40) 


Mean 




Host-Test 


Gam, 


Post-Test 


Gain 




bal n 


c 

V 


^ 77., ■ , 

94.3 


: 2.8 

6.7 


«" 

y42.5' 


■ -6.5 
-4.7 


72:3 

. 38.4 ^ 


-3.7 


D - 


39.0 ' 


23.8 


/53.3 


1 1 .7 , 


46.2 


17.8 


M 


51.4 


' 4.8 


/ 60.8 . 


9.9 


56.1 


7.4 


S 


, ■ 42.9 y 


34.^ 


/ 35.0. 


25.4 


39.0 


31-. 9 


Olean . 


48.9 


'14.5^ 


'/ 51.8 , 


8.0 


50.4 


10.9 


0 




Sixth.Grade • 








Objective 


Farm 6(N=38) 


Form C(N=38) 


Mean 




Post-Test 


Gai n 


Post-Test 


Gain 


Post-Test 


Gain 


C 


73.7 '\ 


. 7.0 


77.2 


8.8 


75.5 


/•7.9 


V 


' .63.2 


10.5 


V 58':8 


6.6 


61.0 


8.6 


D ' 


58.8 


19.3 


70.2 


17. E ' 


\64.5 


18.3 


M 




8.8 


63.2 


3.3 


^.0 


6.1 


S , 


0.0 


-5.3 


55.3 


11.9'. 


27.7 


3.3" 


Mean 


53.7 


8M 


64.9 


9.6 


59.3 


"8.8 



Forms C and 4 combined 

Mean percent of correct solutions 



112 



■ ' ^' . •trobl emv Deck Use and 



Fable 20 

ivDeck Us 
the Quiz Results 



Trial I 

^ — - 



; Total No. of . 

^ Class/ • Miniil oc , , 

iMcher "i^"!^.'-^ ■ _^ o(Jcr(it witn on the 

NunrtJHf ur-dJe B W H /S Total Problem «k Post-Test «,6ain^ 



— — 
13 


4^. 


■ -< 






9 


450 


53.4 


;iT 




6 2 


3, 


2 2 


^5 


210 


- 32.8 


• 15 . 




18 11 


- 6' 


5 3 


, 44 


__c 


M7.1 


22 . 


• 

5 


13 8 


7. 


5 2 


35 


275 
180 


26.9 


14 




4 0 


2 


1 1 


8 . 


■ 42.3 


Mean 




10 . 5 


^5c 






279 


,•40.5 










Triaf II 




■ i J- 



4 3 2. 1 1 11 } 60 ,65.1,31.7 
02 5; 9 5 . '2 1 0 17 120 ' 5>..T,3. 

04 "5 , 4 2 3 2- 1 12 T-gO- .51.3.9. 



21 5/6 



ac 



20 6 3.. -.3 5 7.2 20 3€0 ' 79.0,13. 

Mean ^ 5 3 3 3 V 15 180 / '63.0,14.4 

^ £ 



a 



b 



A post^test on 1^ was used for Triari. b 

Average number^f problems attempted by each student rounded to 
the nearest whole number. 



^ Missing. data. » 
for Trfal II, the data in Table 20 suggests some relationship be- 
tween the performance on the ifulz and (a) the average "^tal number of 
problems attempted and (b) the average number of problem^s attempted at 
each level ^ of difficulty. Also, some relationship appeayrs Jto exist ^ 
betWeen^ the gain scores and the average number of problems attempted* 
Jt)y each student af^each level of difficulty. 
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. V* Summary of student performanC'd on the mbdriile quiz . In 

this section the data from the module quiz for both trials of the module 
was'_ analyzed. Also, a summary and di^rn-^^-- ' thr "-«=>•.' ' ajitii.,- ,it, i 
rel?»t«^H- . . ^iieii o, uit n.oay^ie was presenl^ed.l The results . 

of the data analyzed in this section are summoHqzed belcywland followed 



by recommendations related to possible revisions in t!he module^. 

1. The teacher feedback from^th trials suggests 'thai: the module 
may ha\{« "had. a positive effect on many different areas (see 

' P- 98). ' ■ . I ■ 

2. In Trial I the experimental students outperfdrmed the control^^ 
'students across objectives. In Trial II there were consistent 

"•6 ■ • . " 

pretest ->post-test gains across objectives (with the>xceptit)n 
of the fifth grade" on objective C). 

3. The fifth-grade mean scores in both trials generally ai^ less 
than the means for the fourth and, sixth grades. Some evidence 
wis presented to suggest a possible interaction between scores 

\^ ^ on the Stanford Achievement Test and scores on the module q\^z. 

For example, the fifth-grade stydents' SAT scorel ^jpre general!: 
'lower than the; SAT scores for the fourth- and sixth-grade- stu- 
dents. 



4. 




The mean percent of correct. solutions on all trials was 5lSlL' 
The students in' Trial Ilvseored higher than the students in 

Trial I jl^early every objeWive and grade level. Four pos- 

f 

sible explana,tions were presentedxfor the higher scopes in 
Trial II (si^ p. 103). - ; ^ - 

The-itemsM"n which the student must perform a computation to 
sTolve the problem (i.e., C-type problems) have the highest 
mean scores for all grades, and objectives. - 



) la^^ probT'^rn h quiz is ^ in whicl^Jthe student :s 

iv v-oblem and write his/her work on the quiz 
paper (compeared to multiple choice for the remaining quiz 
/items). Exgepit for the fifth-grade students in Trial II, the 
mean scores on these problem.s wer^ lower than alTother me^iT 
/icores. V ( • 



In Trial II, the ^r^est gain score for tl 
grades is related to. the ''diagram" items. 

A 



he fourth arrd sixth 



"8.— ^me relationship appears^ to exist fdr the classes in^rial II 
between the quiz performance and the average total number of 
problems attempted overall and at each level of difficulty. - 
Also, some relationship was noted between the gain scores for 
the Trial tl classes and the average number of problems at- 

tempted by each student at ^ach level of difficulty. 

.V ■ • / ■ ^ • ■ 

- iv.' Recommendgri:iohs . While the module appears to be* generally 

effective and well receiyeS, there remain some considerations which 

•* .■ 

bear further investigation. '-^ ^ ^ ^ 

1. Further analysis of a possible relationship between the SAT 
scores and the scores on the module quiz shotfTd be performed. 

2. The higher performance of 'the experimental students. co|ngared 
to the~^ntroT*students in Trial I suggests thait the students 
were better able to solve the items"on the quiz as a* result 
of experiencing the modal e, yet thd mean score of correct 
answers for the experiraCTwIVlasseS was only approximately 

• 50 percent. The rel^ively "^w perfqrmapce by all students . 
can perhaps be attributed to (1) the difficulty of the' module 
quiz and/or (2) the difficulty of the- module. 



m 



3. The experiences with u^g* diagrams to sol^ve problems appear 
to ^ave improved the students' ability to solve problem? using 
. ^ diagrams. The large ga.in scores related to' the "diagram" i,tem%. 
. in Trial II suggest that>some consideration sj^l^^ be given 
to determihing if there -/re any features of the Ifepon on 
diagrams which could be used to enhance other' ^sons., 
4. Since some relationship was found betweeW the average number^ 
of^problems^ttempted attach level of difficulty and a * 

Class s 'gain* scores 6n the, module quiz, consideration should 

■A - ' ■ . ■ 

^ be given to a jninimum number of problems tfiat should ^ '• 
attempted al5?«ach level- of difficulty.* . ^ , 

4. SummoJiy and Rexiomzyidcutioru c . ^ 

' The module titled Using /Guesses to Sol ve>^ Problems was involved in 
two field tests .<luring the '1975-76 school ye^r in the Oakland Public 
^Schools, Oakland County, Michigan. The first was from November 4 
thro# December 16', 1975, and the second Irom February 18 through 
March 31 ,. 1976. The f(iijTriative evaluatiorfs/of both trials were con- 
ducted under the general design of the fdrma'tive evaluation given in 
.Chapter A." Data was CjOllected concerning the three major questions 
of the-. formative eyaluations related to the implementation, organize- ^ 
tion an^ content, and effectiveness of the module. This section will 
summarize the results of the evaluation findings for both field tests 
related to each. of th$ major questions. " 

a . ' Implementation : ' " " ^ / '^^^""^ 

1., The instructional booklet andvproblem deck were implemented in a > 

variety of ways. Most of the teachers 'felt that the ability-grouping 

*' A discussion of this issue is included in the revised teach'er's tnodule 



developed as a result of this report. 

■a ■. • 



erJc 
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' . procedures they selected and the aijiQunt ot^Jtime spent on each 

lesson were appropriate for their students. The recommended teach- 



- ing procedures (i.e^r, hQmogeneous team|^ bf four and one/cla^ period 
^^r lesson) appear tc -be one way to impJ^^iB£At"the^ module but not \ 
the only way that can. be su(3ces^fi». ^The teacher's booljlet should . 



i^^^erition that a \rariety of viiys have been^pied ^^n^^^e been found , 
^ to be successful . Several; of the ways that have been used to im- ' 
plement the boMlet and problem deck coul(|rperhaps be described. 
2; ^It appears\tha^ mo4u1e that was used for Trial II can\be 
.taught with one lesson per class period with most fourth-, 
fifth-, and sixth-grade students. 
3. ^The teacher's booklet does not identify a recommended amount, 
of time that the students should work in the problem dqck. Even 
if there is not a recorrenended amount of time, some discussion of 
this^ point should be included in the teacher's booklet.* 
4.. Many of the students In Trial I solved problems sequentially in 
the deck, while most of ihe students in Trial II selected their 
''own problems. Both procedures^'r^lted in a decrease in the 
frequency of cards selected as the level of difficulty of the 
problems' increased. This trend was expected^, 
b.. Organization and Content : \ 

1. A discussion concerning the role of "guess and te£t" in problem . 
solving^ should be included in the teacher' s ^bookl et- 6r premodule 

,^ activities.^ ^ , . \ 

2. The "overview" of each lesson should relate the objective of that 



lesson to tlie pverall objective, i .e. , the "gu^s-arid test" . 
..strategy. A ^ 



^ This issue is discussed in the revis'ed teacher',s booklet prepared as 
a result of this report ^1 " 
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It appears that .the teachers that useti tMs. module are able to 



ictentify for the most part the "guess and! test" process Tn thV 

bookMtr" Those same teachers, mentioned ^hatl?hey 

) • necessary to^ continually rev^iew that f)rocess while the' students 

^ ^ were soTying the problems fh the deck. Since all the te^j^hers 

^ did not identify this process, a detailed discussion oWhe 

"guess and €est" strategy should be included. This recoimiendati 
. . . / ' '■ * " . ■ ■ ■ 

is closely Velated to number one. * • . ' 

4. Nearly all of- the teachers" were satis^fied with the format of -the 

- ■■ ■ ' * 

. . booklet., Specific editorial recommendations are' included in 
Appendix C. ■ . 

5. The .teacher's notes were quite appropriate 'for the teachers in 
Trial II. . ' / • ' 

6. The atphameric code on the problem car«ds should^be explained in 
. the teacher's b^let.* 

. ■ ■- . - ■ V - 

7. Sorijp consideration should be given to a recblfiriendation that a 
minimum number of problems be solved in the deck and/or at each 

' level of difficulty,* in order to establish the likelihood of a 
■ minimum level of masterly. However, it is important to keep in 
mind, that the problem deck was developed so that studenj 
all ability levels could find some success with the problem 
deck; and, as a result, it' may be unreasonable ^to identify some 

nuniber«of problems that should be attempted at each level of 
difficulty by all students. - " 

8. For each problem type, the percentages of problems rated, as ^ 
"like^" are nearly the same. 



* A discussion of the alphameric code is included in the revised 
teacher s module prepared as a result of this report. 



9, The specific difficulty ratings for the white problems should be 

f r • / — 

M considered. Overall , these problems were rated more drfficu*I1L' 
. than tfhe red. problems ;./tiowever, Itost of the white, problems were- 
attempted by fifth-grade .studentSjTBpt sixth-grade students. The 
whit^ problems may be most approprl&te fo|^ sixth-grade students; 

and if SO3 ttT)^is,sCOuld be^ reason why the white problems were>ated 

^ » • ♦ , ' '. ' ^^^^ 

more difficul.t than the red' problems, — 
C. Effectiveness : the section related {^^he "effectiveness" 
of this modul^ was primarily cortcerned with the students' performance 
on the module quiz. However,, it was acknowledged that studfent; per- 
formanc^ Is only on'e dimension of an effective instructional^ product, . 
, Many of-, the other 'dimensions of an effective instructional product ^ 
are^ impli-e4^1y arjid explicitly identified in statements' one through pine 
above. Ap analysiis of the data included fn the^ctions tit'Ted "imple- 
mentation" and "organization and content" and th^ aata related to the 

students' performance, suggests that the module had a positive effect . 

..''*...•■ 

on students^ in several areas, Msifiy of the sulrmary comments and recom- 
mendations that are related to the effectiveness of the module have 
already been stated with reference to the implementation- and organi- 
zation and content. In addition, the following .comments are related 
,to the effectiveness of the module. 

Further analysts of a possible interaction between the. SAT scores . 
and the scores oit^ the module quiz should be performed. f ' 
2, The higher perfj5rmance of the experimental students compaijed 
to the control students in Trial I suggests that the studerrt-5'. 

were J)etter able to solve the items on the quiz as a result . 

' . \ ■ ■ 

of |xperienclng the"Tno)dule, yet the mean score of correct 
' •,* . ■• ' • ' • ■ „ ^ * .. ^ ^- ■ . ^ 

answers. "for the experimental classes was only approximately^ 



50..percent., The relatively low performance by all students ^ 
car) perhaps be ^attribiited to (1 ) the difficulty of the module 
'^"^"^ (2) the diffic^^^^ 1 ? 

JTiie ex^lriences with usinj^diagi^ins to solve problems appear to 
have improved, the •stud^tr a^i'l it to ^ol^e^roblems using dia- 
grams. Tl(ie large gain icores r*i^ted to theV'diagram" it^^^l^/ 
TriaJ^II a^g^t that 50me cpfisideration stioufd be gt)en to deter- 
mining if there- , are ai^vfeatures of. the lesion o^TdiaVams which 
caul<rbe "Used to. enhance other lessons. ' . . " . 
Since some relationship was. found between the average fiugiber of 
"problems attempted at eacli level of difficulty and^a class!^ gain.' , 
.spores on the module quiz, consideration should be. given to recom- 
mending that a minimum number- of problems be attempted at each 
level of difficulty. However, it is important to keep in mind 
that the prt^blem deckiwas developed sd^that students of all abilitv 
levejls (fould firld some success with ttje* .problem deck; andi as a 
n|J^lt, it may be unreasonable to. identify some. numl?er of problems 
that^4!?ould be attempted at each .level of difficulty by aft; 
studentsl i 



I 
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^ - - • O.y USING TABLES TO SOLyt^BLEMS . 

1„ DucAA-ptcon 0^ the. Module. ,^ ^ 

^j^'"^^^^^ .^^^^^ . Using Tables to Solve Problems was involved^in 



one^r.ial during the 1975-76 school year in. the* Oakland Schools : * 
(February 1^ through Miarch 31 , 1976). This is a report of the e.valua- 
tion. activities and findings of that trial . ^ 

The purpose of this'module is.to >Rrovid6 a^qu'ence of experiences 
to introduce stud^ts to thj^ use of es In problem solving/ The 
insy^HCtion^l'bookl&t conteins s^^x lessons and the'prSblem decl4 con-' 

tains five levels of problem difficulty. The six lessoa titles and 

■ - - ■ ' ' *' ■ ■ * ' 

the objeGtives of each lesson are: . .. ' \ \ 

1 . Making Table . ' ' ^ 
Objective: GiVen a physical situation involving a numerical - 

• ^^relatifinshi.p, the students vyill 'place entries in 

■•• ' ■■ ■■■ ■ - ' . r ■ 

a tab-le that describes the numerical relationship. 

2. Completing a Table '. ' ^ 

• ' Objective: Given some entries in tables, the students will 

• determine the. relationship^lind complete the table. 
.3.' Using Tables to Solve' Pro blemV _ * " 

Objective: Given problem Situations , the student wTll make 
tables to solve a serie&-rff related problems. 

4. Usiog Tables -to Solve Mor^ Problems - 

Objective: Given mathematical problems, tfie students will build 

vv tables and. deteirmine entries to^blve the problems. 

5. Reading Tables ^ , . 

Objectivje: G-iven a completed table, the student will be able 
, . to read the^ table to answer a list 'of questions. 
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Objective:. To acquaint students with the problem deck., 

this mojlule is to jnt 




It,is* important to note that the purpose 
•duce students to thV use of tables in prdblem solving. This module w 
developed 'as part one of a two-module sequence on using tables to .' 
•solve probl^s. Part,two of the sequence has not been developed,. As 
a result, the objectives of this module. do not include pll'the objec- 
tives one might identify as releyant forusing- tables to solve prbbler 
E^ch card in the.^oblem deck.v in ad^dition to being color-coded t. 
i.nlT^'a^e difficulty 1 eve l.^was, coded with a letter, to indicate the tyi 
Of problem; BelovT ajie the lette^VodeS and an example of each pr6bl( 

type, * . . 

■ ^ ■ -f 

"c^plete the. table" 



1BC1 ^ 
■COMPLETE THE TABLE. 



Number of 
tricycle? 


, 5- 


V 


20 






.Number of 
wheels 


V ■ 

1 ■ 


30 






300 



ttint: Each tt'.i^yc 
has 3" wheel 



S - "answer a s.equence of questions" 
• 5BS1 . ' :•' ■ • ' 



Hint: 



. Turns of. Reel 


3 














Feet ^ V 


.5 















Every time :) 
turn, the^-^har 
- 3 turns , the 
goes down 5- 



1. The ftsh locator shows; fish at l&,feet. How many turns^ o^ 
^ handlejliouj^d I make^b T&'w^ the bait J 5 feet?. ' ^ :<^ \ 

2. About how deep .are you f ishing when it takes 12 tufns of th 
handle t6 rj/se the^ bait to tfiie^uP'f ace? / •. 



ERIC 



M - "make a table" 

6BM1 , V 

• MAKE A YABLE WITH 5 MORE ENTRIES TO SHOW THE NUMBERS OF WHEELS 
NEEDED. : • 



Wagons 




2 












"i^heels 
J, 


4 


8 













Hint: Each wagon has 4 wheels. 



• "answer^ tlie bottom line question" 

A . ■ - 

29BB1 • . . . 

A cartoon commercial runs at 24 frames^^per second. An artist ha 
to draw a cartoon for each frame. ' m * . 



Seconds 


1 










Frames 


24 











How many cartoon drawings does an artist have to make for a 15- 



, second "commercial? , . * ' <• C: 

Hint: For 10 seconds you would^eed 24P;dra'^^^ 



/ 



R - "read the table" 
27t?l 



AIRLIfiE MILEAGE CHART 




0> 



/ 



4 



Chicago 


" X 


901" 


1746 


719 


1847 


617 


Los Angeles 


1746^ 


-849 


• X 


2454 


340 


2286 


New York 


7t9 . 


1617 


2454 


X 


2566 


200 




< 
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How far is it between these cities: 

1. Chicago to Denver? 

2. Los Arjcieles to New York? 

3. New York ^o Washington, D.C.? 

•Hint: " Ffhd the row for Chicago. Then read Jhe number under 

Denver. That number is the distance in miles from 
Chicago to Denver. 

Table 1 ^hows the number of cards of each type at each level of 
difficulty.' 

Table 1 

Total Number of Problems of Each Type 
at Each Level of Difficulty 



Type of Problem 





C 


S 


M 


B 


R 


Total 


Blue 

(Easiest) 


9 


' 8 


10 


2 


4 


33 


Yellow 


10 


6 


9 


3 


. 6 


34 . 


: White 


6 


12 


1 


6 


12- 


37 


Red 


4 


4 


5 


10 


6 


29 


Green 
(Hardest) 


6 


6 


3 


5 




■23 


Total 


• 35 


36- 


28 




31 


156 
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For each of the first five lese'ons the recommended "teaching proce- 
dure" was: 

1. Discuss the opening scene (given in the booklet). 

2. Guide the students as a whole class through two or three pages of 
the lesson. ' v 

3; Observe and listen to the students as they work in independeik small 

groups on several- pages of the module. "^ 

•*. ■ ' ' / ■ . 



. '4. Give "optional problems*' to ^groups who finish early. For 
l^son six, the teachers were to prepare the students to ' enter th6 
problem 'deck by. having them sol vie problems, ^n addition to these 
recommendations, the .module developers suggested: 

- one class period be spent on each lesson, and 

- small groups of four students is the "bestT way to ottganize the 
class for presenting the module. 

2. EvaZuat^n Voj^Zgn, / 

a. , General Design : • f he evaluatiori of the module was conducted 
under the general design of the formative evaluation given in Chapter A 

' of this report. Data was collected related to the three major ques- 
tions of the formative evaluations: 

^hat implementation strategies are appropriate for the ' instruc- . 
tibnal modules?, 

2. Is the organization and" content of the module appropriate for 

r. ^the intended population? » ' f ^ 

3. How effective is the module? ' 

All instruments used to collect data* and 4:he number of classes 'in which 
the inslJfument was used are shown in Table 2. / 

Teacher coiments concerning the booklet, and problem deck were dis- 
cussed as a group at. the in-service'^session rather than written in the; 
module. The evaluation staff did not decide to collect samples of stu- 
dent work for the formative evaluations until after the date the teachers 
had begun working with this module. ^Due to time constraints i .classroom 
observations and written comments from the prjvject staff were not col-, 
lected. Also, the quiz was not availablaointil the end of instruction. 

b. Quiz : Two fdfms of a quiz w^ developed for the evaluation , 

(see Appendix D). The objectives/to be measured by the quiz were: 

* f 
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Number of Classes^ frbm Which Data 
Was Obtained for Each Instrument 

4 



Instrument 



Number of Classes 
Cn = ^) 



Time record-instruction&l booklets " 8 • 

Time record-problem deck . , 4 

Lesson rating form ^ ' . g 

Irvterview questionnaire" . 5 

Teacher debriefing ,que.stionnfii re . ' q 

Teachers booklet (with comments) q ) 

Teachers, problem deck (with .comments) *^ 0 

Student quiz ^7 

Student records-problem deck , ' 3 

Student work (sample) (' . , , ' q 

Classroom observations •> . , -0 
In-service tape recordings . " 

Instructional module '(with comments) 0 



*This number refers to one tape recording, not the number of classes/ 

1. Given a Vablle., the students will be able-to read the table. 

1 , . r 

2. qiven a. table, with two categories and the entries in the f.irst 
cqlumn, the student -will be able to generate other entries in 
the table,* . - ' 

3. Given a table^h three categories arid a random selection of 
the entries missing, the student will be able to complete the ' 
table. 

4. Given a problem and told to use. a table to solve the problem, 
the student will correctly a) writAhe headings for the table, 

\ b) complete some entries in the table, and c) solve the problem. ' 
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5. Given a problem in which a table coula be used to obtain the 
, /solution but was not suggested to the student, 'the'^student will 

a) use a table to solve the problem, and b) correctly solVe the" 
problem. 4f a table is used, the student should enter accept- 
able headings for the table. 
The objectives to be measured by the quiz were developed by. the 
evaluation staff at Indiana, not by the module developers, the 
jectives of the quiz were, for the most part, congruent with t]i^<i^b- 
jectives of tVie module; however, one exception needs to be ndted. 
Objective 3 was^not an objectr^of the module, but since ^he problem 
deck^ contaids- several three-category, tables, thiS; objective was in- 

c\tfded as one to be measured on the mociuj/e quiz. 

. - L " ' - ■ \ 

The Items written to measure each objective on each form are: 

Items - Form A Objective Items - Form B 

.' , 1 • _ 1 ' ■' * 1 • , • 

rf 2 '2 2 - 

^ 4 > <4 4 ' 

.• •< . . 5- : ■ 5 . •■• 5 

' • 'li-' .J 

For problem 1, all four parts on form A and three out of four parts 
on form's are multiple-chdice items. The<. fourth part of number 1, form B, 
is a- completion item. The remaining problems on both forms are ones ir 
where the^stuMpnt ts requir-ed to complete or generate a table. Table -3 
shows the criteria arid corresponding pdints that were assigned to the 
Items for the purpose of scoring the quiz^ 
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Tabli 3 

Criteria and Points for Each Item 
'o£ the Tables Module Quiz V 



Item Criteria 



Point? 



^ Correct answer ] 

Incorrect answer 0» 

2 All entries ire correct ^ -2 
Some entries are correct .1 
No entries ar? correct n 

3 All entries ^re correct , . 2 
Some entries are correct i . 
No. entries are correct * 0 

^ \ Correct headings ' 1 . 

, ' . Incorrect headings 0 

All. entries correct ' ^ 2 

Some entrfes correct ] 
M entries. correct 0 

Correct answer ] 
Incorrect answer n 

■? . 

5 * Correct aaswer . / 

^ Incorrect answer 

. ■ . . 

Used a table to solve - . ' i 

Did not ;use 'Si table to solve 0 

There is eviclence the student " - 
tried to u5e a'ta^le ^' 1 

^- , v'^ No. evidence of .a table d ' ■ 0 

Correct headings ^ ] 

Incorrect headings ' q 

^ No structural error " ^ 1 
Structufal ^rror (An error in 
understanding the problem) 0 

No executive error 1 
• , Executive error (An error in 

, manipulation or calculation) 0 



1 
0 
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All of the ;teaehers except one gave the quiz tb. their students after 
at least three weeks of work with the problem deck. One teacher was ill 
for an extended period of time and admijjdstered the quiz to his students 
>when they hajl had no work in the, problem deck. This will be coimented on 
furthejh in the analysis section of this report. Each teacher randomly 
distributed the two forms of the quiz to hi s/her^ student's so that one , 
half completed form A and the Other half form B. 

c. Data Collection : \ The first teacher In-service session for thiS 
module. invoTvecl all of th^ activities described in the "general evalua- 
tion design" of, the formative evaluations. The data collection outline 
for the formative evaluations involved three additional in-service ses- 
sions for the primary purpose of evaluating the modules. Due to ice 
storms, the first and second evaluation in.-servlce sessions for this 
module j||r4 cancelled. A? a result, thj^feedback on the booklet and 
problem \djBck was obtained during the third session. 

It ts Important to note that the group of teachers (flroup 11) that . / 
field tested this module consistedl of only fifth- and^s^xt^v^r^de - 

■ . ■ ^ ] ^" ' . ■ ■ ■ ■ ' .i^ 

teachers and students. No data is available to determine the appro- 
priateness pf this module for fourth-grade Students. 
3. Ancity6^ and Rq^ujU6 - 

a. Implementation : The formative evajuatii)n attempted jbo answer* 
four, questions with respect to the implementation of the module: 

,1. How do the teachers Implement the instructional booklet and r 

' ^ ^ \ r 

problem deck? . I 

« » 

2. How much time do the teachers spend on the instructional booklet 
, and the problem deck? m 

3. How many problems at each level of ' difficulty were selected? 
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. 4. . What recommendation/^^do the teacher^ have for impleinenting the 
• modules' in the curriculum? > 

Dgscriptio h of Implementation Procedures . Table 4 shows the 
implementation procedures' used by six of the teacheV§. In an effort to 
. examine how wen, the module' "f it in" with the teacher's usua*- instructional 
mode- the teachers were asked to" describe their u^ual instructional mode 
in mathematics and other areas and compare thei^ usual procedures to their 
work with the module. It is irfteresting that many of the teachers changed 
instructiona^l modes when they/ beg an working with the,modul| (e.g., individ- 
ualized to whole Class) and that none of the teachers^^^^^ any difficulty 
with the change. , It. appears that a variety of ways wer^used to implement 
"the booklet and all the teachers were pleased with , the approach they selected 
A variety of ways were also' used to implement the problem deck. Most of the 
teachers did use' some form of small-grOup instruction and- homogeneous 
grouping seems to .have w^ed best. It is also^important to note that in 
most of the classes, the students selected their own card^, rather than the . 
teacher as^igning^ the cards.; - • • " • * 

The format of tfjis' module (an instructional booklet .followed by a 
problem deck) -is one of several that could be used .to teach problem solving" 
strategies and skills-. Another format would- be to provide the students 
with carefully selected problems and simply have the studerffcs solve a Jot 
of problenTs. Since the research on ^jroblem solving is not conclusive con- 
cerning efficacious instructional formats, the teachers were asked whether 
the instructional booklet was necessary or whether some form of practice 
with the problem deck would have been sufficient for teaching the students to 
use tablet in problem solving. The teachers' responses to this issue are 
part of'^e statements listed under "transition from booklet to deck" in 
Table 4. The other statemeijts under this heading refer to the issue of 
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7 



126. 



Tab\e 4 

Implementation Procedures for the 
: Bookl-et and Problem Deck 



I Teacher ' Usual in- 
number/ struc t i ona 1 
grade mode 



Booklet 



Transition 
Deck from booklet 
to the deck 



.Comments 



08/5 



28/5 



.29/5-6' 



05/5-6 



-Math-homo- 
geneous 
groups of 
6-10 

-Whole class 
in other 
areas 



-Khole 
class 



-Math-com-, 
pletely 
indiv'idu- 
alized 

-All rnodes 

y in other 

^areas 



-Math-com- 
pletely h 
individu^, 
al ized ^ »' 

-AIT mode^ 
in other 
area? 



-Small 
groups and 
individual- 
ized in all 
areas 



-Whol? 
class 



-Whole 
class 



;Whole 
class for 
the 1st 
page, then 
individual 
work . 



-Students 
selected 
teams(2-4) 

-Usually 
homo- 
geneous 



-Good 



-Heteroger 
neous ^ 
group,s(3- 

-Teacher 
assigned 
groups ' 

-Sel ected 
own eards 



5) 



-Good 

-Booklet is 
needed and 
first 

-He; needed 
to review 
the book- 
let at J 
times 



-Problem 
deck is the 
heart of 
the module 

-The mode he 
used was 
felt to be . 
the best 
considering 
all the ones 
he tried 
last year 

-He would yse 
homogeneous 
groups the 
next time 



-Students 


-Good ^ 


-Worked well 


selected 


^ -Booklet is 


for these 


-Tended, to 


needed and 


-students 


be homo- 


first 




geneous 


-She needed 




-Group^ mem- . 


to review 




bership 


the book-* 




changed 


let at 




-Selected^ 


times 




own cards 






-Student 


^-Good 


-None 


selected 






groups of 
2 






-Selected 






own cards 
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Table ,4 (cont.) 

Implementation Procedures for the 
. Booklet and Problem .Deck - 



Teacher 
number/ 
grade 



Usual in- 
structional 
mode , 

— Ar 



, Transition 

Booklet Deck from booklet 

to the deck 



Comments 



18/6 



24/6 



-Heteroge- 
neous- 

SJipups in 
all /areas 



-Individual 
work 



-Homogeneous 

groups of 
^Teacher se- 
lected one 

member of 

the group 
*to explain 

the.solution 
-Students moved 

at their own 

rate . 



-Good 

^ooklet is 
*a good in- 
troduction 



-Workefd, 
we1 1 



:Individual- 
' ized |n all 
areas 



-Whole 
class for 
the first 
3 lessons 

-Some went 
individual- 
ly, most 
remained , 

'With'the 
whole 
class 



-Individuals 

& small 

groups 
-Selected 

own mode 



-Booklet 
*made stu- 
dents "will- 
ing'" to 
try prob- 
lems 



-None 



■■ ; ^ - ./ '- ^ -T-^ 

^^'^^'^^^'^'^'^^ ^'^^\'<'S3^^^'^Q'(\^^ booklet prepared the student to enter the 
prqbl^ deck. T'he responses from the teachers indicate that (1) the ^ 
boeklet is .needed for instruction in grades 5 and 6 and (2) the booklet 
adequately, prepares the .students to enter the pVobrem deck. 

,J^' Amount of Time . Tables 5 and 6 show the amount of time ^ 
each teacher spent' with the. instructional booklet. Almost every lesson 
was taught in one class session with the mean "length of a session around 
45 minutes. Although teacher 95 took nearly two class sessions for each 
lesson, the mean number of minutes he spent on each lesson was less than 
the mean for all, teachers.' The fifth- and *fifth/ sixth -grade teachers spent 
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approximately' the same number of cVass sessions on each lesson -as the 
sixth-grade teachers but required a greater number of minutes to complete 
a lessdf).: This data agrees with the reports of the fifth- and fifth/ sixth- 
grade teachers that they were "pushed" to complete s6(^ of thq lessons in 
one class period of "usual" length. Lessons 2 and 3 required the greatest 



number of class periods and minutes to complete for all of the teachers. , 
•Another observation from Tables 5 and 6 is that the number of class periods 
used for. each lesson and the leni^th of each period remained rather constant 
fo> each teacher'. Other than the two observations that (1) lessons 2 and 3 
requtred the greatest amount of time and {2) fifth-gi^ade teachers had to 
spend more minutes on each leSson than sixth-grade teachers, the fluctua- 
tlons^in the amount of time spent on the booklet seem to be a function 
af the ibd^vidual teacher's style. The data in Tables 5 and 6, together 
with the teachers' commeffts, suggests that: i " 

1) most q/ the ^lessons can be taught in one class period at grades 
5 and 6; * ^ 

^ 2) the^lessons require on ^he average 45-50 minutes to complete at^ 
grades 5 and 6; and ^ 

3) lessons 2 and 3. should perhaps be shortened. 

Four teachers recorded the amount of time spent on the problem deck. 
TabTe 7 stiows the reports of these t^i^chens. When the teachers were 

■ •. • ■ '\ . ^ . ' ■ 

interviewed concerning the' instructional patterns they selected, each 
teacher was satisfied tha.t hts/her approach was successful in his/her 
classroom. These four teachers each spent arouiid three weeks with the 



problem deck, /j^though several teachers commented that they could havj 
used more time to solve problems, in the deck, t|iey feH that three wefeks 



I- 



.Teacjier 
Number - 



Grade 



Table 5 ' 

Number of Class Sessions 
for Cach Lesson 



Lesson 



. 08 


•5 


1 


1 


" 28'. 


5 \ 


1 


1 . b 


.. 29- 






1 


, 05. 


5/6 ' ./^ 




2 




6 • 


' 1 . ' 


1 


' ..09 ' 


'. 6 - 


1 


l' 


^ 18- 




1 


' 1 


. ^4 

r 

I ' — 




' 1 ^ , 


' 1 




Mean 


1.1 


1.2 



1 

2 
1 
2 

T 

2 

1. 

1 



•Mea n 



)1 . 4 1.1 1.0 



1.0' 
1,3 
.1.0 
1.8 
J.O 
1.2 
1 .0 
1.0 



1.12 



X 



. ' Jable 6 

Number of Minutes Spent 
on Each Lesson 



Teacher 
flufnber 



Grade 



08 
.28 
29 
05 

or 

09 
18 
24 



• 5 
5 
5/6 
5/6 

6; 
6 
6 
6 







Lesson 








1 


2 


3 


4 


5 


6 






4... 


2 


2. , 


2 


4 


r 


4 


3 , 


.5 


4 


4 


2 




3 


. 4 


4 


4 


4 . 


_b • ' 




2 


4 < 


.4 


2 


2 


1 ' 


f 


2, 


2- 


2 


2 ' 


2 


2 




4 


4 


4 


2 


1 








'4 


3 


/ 4 


4 


1. 




1 . 


1 


1 


1 


1 







1 - iless than 35 min. 

2 - 35-45 min. 

3 - 45-55 min. 

'4 - 55-65 min, ' • •• , 

5 - gr,6ater than 65'min. 

Data wfrs not, reported for^ythe empty cells, 
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was^an adequate amount 0/ practice prior to takfng the quiz. The data 
-from fable 7 and teacher interviews indicate, that the-probletrrdeck was 
implemented using a variety of instructional patterns and the teachers 
were pleased with the approaches they selected. - *' 



Table 7 

The Instructional Patterns/Time 
Tha-t Four Teachers Spent 
With the Problem Deck 



Teacher Number 



rhstructiohal Pattern/Time 



08 



24 



28 



29 



The deck^was'available for 18 days... 
students worked on. cards .duringj^"free time. 

The students used thp cards twice- a week 
for three weeks. 

The deck was used for five "consecutive 
complete periods and two more periods on 
successive Fridays. 

The deck was used for four weeks, two or 
three times per week, for one-half hour 
eaqh time, ' , ' . ' 



ill. Problem Card Selection ., t)nly three teachers provided a 
record of the problems t^^students selected. Tabl« 8 shows that th"^ 
fr'equency of cards selected generally decreased as. the difficulty in- 
creased. This observation is interesting since the students in nearly 
every class selected their own cards. Class 29 attempted a great many 
more prpbl. ems than. the other twa classes. The section on . "effectivene$s" 
will, examine whether the number of problems attempted by class ^29 'compared 
to the other two clashes is reflected in the performance on the module 
quiz. . 



[J Table 8 

-Total. Number Of Problems Attempted' 
-at Eacl)' Level- of Difficulty ^ 
fiaf Three Teachers . y; 



Difficulty 
, i Level . 




Teacher* Number 






■ ■ .08 


28 


' 29." 


Total- 


' Blue ■ 




■ ' 102 


, 3.09 ■ 


568 \ 


. YeHow 


. . . ■ 


171 


■ 100 


360 


White- 




^ • 33 ■ 


78 


^ 19^ 


Red 




* 

66 


^1 


>172 


Green 


- ' 43 . 


1 


32 . ■ ' / 
^ \ 


,."82 

• 


Tot^l 


4,15 


379 •/ 


^580 . . 


- .. . — 



' I ia2. 
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iv. Comments and Recommendations , The data discussed in this 
section suggests several recommendations related to the implementation of 
the m(^ule: 

1. The instructional booklet. and the problem deck were implemented 
in a variety of ways. Evel^y teacher felt that his/her methods were 
appropriate^!^ his/her students. The recommended teaching procedures 
given in the teacher's booklet {see pp. 119-120) appear to be one method 
for' using the module. The teacher's booklet might list se\)ieral other 
methods that have been used to. implement /the module. , 



2. It appeans that the booklet can be used in six days (one day per 



lesson) with most fifth- and s.ixth-grade students: lessons 2 and 3 
should be shortened. The problem d^ck was uSed for approximately * 
three weeks prior to adm'lnisterincj the module. All classes, however,' 
did not spend the same amdunt of time with the problem J&ecJ< during the 
three weeks. Although the teachers stated they could haye useVi moire 
time with the deck, they felt that their procedures for implementing 
the problem deck during the three weeks ^were adequate preparation for 
the quiz. The teacher's booklet does n9t; identify a recommended amount 
of time for the' students to work in^the deck. v£ven if there is not a 
.recommended amount of time, some discussion of tf|is point should be 

1 \ 



included in (the teachei^s boSklej/. ^ \ 



3. Most of the students were allowed to select their own ca 



j/r own cards | 



from the, d«ck. Three teachers reported the card selections with 580 
415, and 379 problems attempted in these classes. The sectton tnied 



"effectiveness" will consider whether the number of cards attempted 
is related to the performance in these three classes. 

b. Organization and Content : The formative evaluation' attemptejd 
to answer a variety of questions related-to the organization and content of 



'^he I 
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the module. The following instKuments/forms/ in Appendix D should be 
examined to identify the questions considerjd in the, evaluation: 
Interview questionnaire 

- Teacher debriefing questionnaire 

- Action research discussion questions/ 

- Lesson rating form - 

t 

^ Appendix D contains a summary of the /data obtained from the inter- 
views a'nd discussion sessions. This da ti, together with the results of. 
the Teacher Debriefing Questionnaire and Lesson Rating Form, indicates that 
nearly every teacher involved in the f/eld testing of this module was 
pleased with: ' . , , / . ' - < 

1. the congruency between the objectives and the contept of the module,- 

2/^ the display af?d format of/the booklet and problem deck, and 

3. the mathematical, psychotogical, and pedagogical appropriateness of 

the-module's content for the grade and ability levels of the 'students 
Both strengths and weaknesses of the modufe can be identified from the 
data. - Ttie teachers reported that the major weaknesses of the module were: ' • 

1. The module lacks variety in^Tfat: 

a. ^ most of the problems are' "constant ratios," and 

b. there are very few problems of the type where the students are 
given the problem statement, asked to solvere problem using' 
a table but not given the headings^nd some of the entries. 

2. The booklet does not emphasize for the teacher and student the ' 
variety of ways that one can generate the entries in the tables. 

3. The module does not explain the difference/relationship between 
using tabj^ versus using organized lists to solve prnh1pm«; * . - 

* ^''^'°^*? tfie "tables" modules, the?.e teachers field-tested the 

' Organizing Lists module. The teachers f^elt that if both modules are ' ' 
to be used by a teacher, a discussion of the difference/relatlonsh'ip 
between the two modules would be useful. ■ 
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he first weakness must be examined related to the purpose of this 
dljle. The purpose is to introduce students to the use of tables in 
problem solving and not to 'provide all of the experiences related to 
this skill. Since the teachers were unaware of the "introductory" pur- 
pose of the module, this first concern of the teachers is not of major 
importance. It does imply, however, that this module alone cannot be 
presented to teachers as .one that Contains all_ of the skills related to 
using tables to solve proble^ms/ 

At the first teacher session the project staff provided a detailed 
explanation of the module's content. Included in that explanation was 
^ a discussion of the variety of ways that can be used to generate the • 
entries in the tables used in the module. During the individual teacher 
interviews, nearly every teacher commented that r*t hey would not have 
seen the different ways to generate entries if it had hpt been for the 
iif-service sessions. Moreover, every teacher stated that the teacher's 
notes were not useful in this respect. This was further evident from 
the responses on the Lesson Rating Form. The teachers also felt that 
the module attempted to "show" the students how to generate entries 
.through the use of true-false items but mor*e emphasis was needed. Two 
of the fifth-grade teachers and the teachers who had some fifth-grac^ 
students in their^lasses felt that fifth-graders had greater difficulty 
generating entries than sixth-gradws. This wiU be commented on further 
in the "effectiveness" section of thisTepfifrt. 

Group 11 .field tested the module titled Qr^n^ing Lists; three months 
before using this module. Although all of the teachers felt there were 
differences "and similarities between the types of problems in the two 
mod|4jLe6, none'^vas abte to identify the difference(s)/relationship. 

Since the developers feel that the heart'of the module is the problem 
deck, the patterns in problem card selections, are of particular interest. 
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. Tables 9, 10, and 11 Kere developed for this purpose. The ^'olTowing 

\ ■ ■ • . • ■ : 

observations seem the most salient with respect to. the problem card 

»' ■ 

selections. (Note: The data in these tables is the result of feed- 
back from only three 'teachers. ) 

. . . • 

• . Table 9 

total Number of Problems 
Attempted for Each Problem Type at 
Each Difficulty Level 



• Difficulty 
Level 




^ Probl^ Type 








C 


S 


!M 


B 


- R 


Total 


Blue 


239(9)^ 


129(8) 


167(10) . 


5(2) 


29(4) 


568(33) 


: Yellow 


101(10) 


77(6) 


108(9) 


41(3) 


33(6) 


360(34) 


* White 


30(6) 


64(12) 


13(1) 


49(6) 


36(12) 


192(37) 


Red 


25(4) 


15(4) 


52(5) 


58(10) 


22(6) 


J72(29) 


Gi^een 

. t " . -p 


18(6) 


16(6) 


^ 11(3)' 


33(5) 


4(3) 


82(23) 


Total 


412(35) 


301(36) 


351(28)' 


186(26) 


124(.31) 


1374(156) 



N » 3 - ^ - . 

b '' ' - ■■ ■ ^ ' ' ■ ) ' 

(9) cards of this, type and difficulty level /r,e in the deck. 



Tablft 9 



The "reading" CR-type) problems were tried on the average by the 
fewest num ber of students . The quiz results to be discussed in the next 
section show that around ninety-five percent of the students were able to 
read tables. ' 

.2. The S- an d :B -type problems were. attempted fewer times than the C- 

and M-type problems . Although the.S-, B-, C-, and M-type problems all / 

require the student to con^lete a table, the S- and B-type problems ask 

• ■ • '• ' ' , ■' 

the student a question (B-type) or questions (S-type). Perhaps a question (s) 
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on the card led the students to select these types of problems less n*e^ 
quently..- 

Table 10 * 

Percent of Total Number of Problems Attempted 
for Each Problem Type and Difficulty Level 



Difficulty 



Problem Typ6 





C 


S 


M 


B 


R 


Total 


Blue 


17(6)^ 


9(5) 


12(6) 


<1(1) 


2(3) 


.40.5(21) 


Yellow 


; ' 7(6r 


6(4) . 


8(6) 


3(2) 


2(4) 


26(20, 


White 


^ 2(4) 


5(8) 


1(1) 


4(4) 


3(8) 


15(25) . 


Red 


2(3) 


•1(3) 


4(2) 


4(6) 


2(4) 


13(f9) 


Green 


1(4) 


1(4) 


1(1) 


2(3) 


<H2) :, 


5.5(15) 


' V — 
' Total • 


29(23) 


22 (24) 


26(16) 


13.5(16) 


9.5(21) 100(100) 



(6) percent of the total number of cards In the deck are of this type ' 



at this level of difficulty. 
Table 10 



3. Twerity-one percent of ,al 1 cards were R -type problems while only 
9 .5 percent of all problems attempted were this type . The teacher inter- 
views revealed that these problems were good for motivation but reading 
tables was not a new skill for-the students in these classes. . 

4. Nearly 30 percent of all the problems'^ selected were type C with 

17 percent of the 30 from the blufi difficulty level . Nine blue cards 
■ ■ • . ' .■ ■ ■ \ 

were C-type with seven of the nine located in the first third of the ^ 

. blue probl ems. > Although most students selected their own. cards, the 

data 'on the individual problems indicates that the students selected most 

''MkfM the problems from the first third in each difficulty level. The large 

percentage of C-type (and blue-C-type) problems selected may be due to 

the location of .the cards i.n the deck rather than to some other character- 
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istic of. the problems, 



Table 11 /• 

Percent of Students that Rated Problems as 
Hard and Disliked at Each Level of 
Difficulty and' Probtem Type for Three Teachers 



■J* 

Difficulty 
Level 


w ■ 




Problem Type 


• 








C 


S 


M 


B 


R 


Total 


Blue 


9,13^ 

> 


8,12 


2, 6 


0,20 


7,11 


7,11"" 


Yel low • 


29,23 


18.17 


10,12 


5,15 


s 

12, 3 


- 17,16 


White 


13,13 


8, 8 


'0, 8 


6,10 


3,11 


7,10 


Red 'v 


.3^,16 


7, 7 


^,15 


22,22 


• 18,18 


. 17,17 


Green - 


33,22 


38,25 


' 2X27 


40,30 


' 25,25 


35,27 


Total 


16,16 


12,13 


7,10 


1.7,19 


/ 10,14' 


12,14 



I^K^^ "Easy"_and "Liked" can be found by subtracting e"^ch 

number from 100 respectively. 

Table 11 ^ , ' 

5. For all the pfob].ems att empted, nearly 90 percent were rated by. 
.he students as "easy". and "liked ." ; 
^' The yellow type C. S, and M problems appear to be rather difficult , 

7. Within the gr6en problems, which were Considered to. be the most 
difficult, the S- and B-type problems were rated the hardest. (These types 
are characterized by the use of questions.) 

8. For all problems, the C-. S-, and B-type problems were noted as 
the hardest. Although the S- and B-type problems are characterized by ' 
the use of questions, many of the C-type problems also contain questions. 

^' The C-type problems were consistently rated the harde st for all 
'difficulty, levels save level green . * 



Hz 



" The ^data discussed In this section suggests the following recommenda- 

V . tlons related to the organization and qontent of the module: 
Instructiona l flooklet t v 

— • : ~ 7^ 

■ * . 

1. The "introductory" nature of this module should be discussed 
|. .In the teacher's edition and perhaps^mentioned in the title of the 

module, . 

■ ■ ■ . • ' ■ ' 

2. The role of "tables" in problem solving should be explainedi^to 
the teachers in the teacher's edition. 

3. If teachers are, to use this module without ^the aid of irj-serv^e 
education, the teacher's notes should provide a detailed presentation of 
the mathematics in the modulev ^ ' 

. 4. The instructional booklet should provide additional emphasis related 

. - ' ' ' . ' ' ' ' 

to the variety of ways to generate e^ntries i^n tables. Implementing recom- 




mendation 3 could alleviate the weakness 4hat motivated this^ recommendation 
and/or additionaT material could be provided in the student booklet. 
Problem Deck 

5. The quantity of reading (R)-type problems should be reduced and/or 
,the difficulty of these problems Should be increased for f if th^ and sixth 
gr*ade students (see p. .140 for a further discussion of this recommendation), 

6. The C-type problems at the blue difficulty level should be more 
evenly distributed awng the set of blue problems. 

7. The yellow type C, S, and B problems should be examined for their 
location in the deck. Some of these problems should be moved to a higher 
difficulty level, , ^ . 

B.\ The. distinctions between all the^problem types should be discu^.ed 
In the teacher's booklet. Particular attention should be given to the dis- 
tinction/ilmllartty between the C- and B-type problems. 
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139. 

9, Relatively high percentages on "hard" and/or "disHke'; suggest 
that the fol 1 owing ptf'obl ems be exami ned : bl ue - 8 „ 19 , 20 ; yel 1 ow - I, 
16; red - 2, 3; green - 1. 

10. The alphameric code on the problem cards should be explained 
in the teacher's- bookl etc ' , 

, C Effectiveness: The two previous sections concerned implementa- 
tion- and organization and content of the module'. This section will be 
primarily concerned with the data from the module quiz re.lated to stu- 
dent performance. < 

Teacher .judgment. Data from the in-service session and the 
teacher interviews provide some evidence- related to the effectiveness , 
of. the module. 'Some of the teachers' comments are: 

- This is the best module we've used, (four teachers) ' 
. - The.'students had good attitudes, (six teachers) ■ 

- Some carry-over was noticed in other areas, (two teachers) 

At some point during th e evaluation activities every teacher commented 

that his/her students had attained the objectives of this module. Also. 

nearly ever y teacher stated that students of all ability levels were 

able toAfind some success with this module . 

il.-„Quiz results, ^h^order to prnviHp -"^Hif inn^T evidence of 
whether the students did attain the objectives of the module, the quiz 
results will first be analyzed and discussed related to each objective. 

The objectives of the qufz were developed by the evaluation staff 
through examining the activities in the instructionar'booklet and the. 
types of problems in the problem' deck. - As a result, the-quiz results 
can be analyzed with respect to the content of the booklet and 'the 
problem deck. ' 
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, . . . • ■ . , ' 

Table: 12 shows the results of t-hie module qiiiz for each- form and 

at each grade level. A. specific criterion levelfor successful per- 
formance was not established. Rather, the quiz results were examined 
for any trends that suggested changes in the module. The five ob- 
jectives to be measured by the quiz are given on pages 121-122. The 
quiz results suggest the following related to these objectives. 
Object] ve 1 : Nearly every student (93%) was able to correctly read 
a table. This data, together with the fact that very few stu- 
dents selected the R-type problems in the deck, suggests that the 
"reading" problems may be rather easy for most fifth^and sixth- 
grade students. Several teachers commented that reading tablfe^ 
was not a new skill for fifth- and sixth-grade students. However, 
they did feel that the lesson on reading tables was useful for 
'motivation. Also, it is possible that the high performance' on 
problems' concerned with reading a table is the result of their 
prior experiences, with the lessons relatisd to completing tables. 
That is; the skill of reading a table may be developechas 4he 
. student h6is experiences with completing tables. 
Objective 2 : The problems related to this objective require the stu- 

• . '* i" 

dent to complete a table with two categories. .The problem's re- 
lated to objective 4 lalso require the student tp complete a table 
- with two categories. On all of the problems related to these 
two objectives, when the criterion is "correctly completing some 
of the entries^" 80 percent of tfie students met the criterion. 

.' This level of success may perhaps be attributed to t;he large 

- ♦ • 

riumber of problems In the deck that were attempted where the 
< student wais (at least) asked to complete a two-category table. * 
Except /or the "reading pro bliems" and 10 problems that have three . 



Table 12 
Quiz Results: Form A 



Problem No. 


' Criteria^ 


Maximum'' 


5th Grade 
Mean (N=41) 


6th Grade 
Mean (N=54) 


.1(1) 
: 1(2) 
1,(3) 
1(4) 


r 

"* 


1 ' . 

1 

1 

.1 


.89 
. .89 
.91 / 
.93 


.94 

^.94 
.96 , 
.98 


2 


correct entries 


2 


1.53 


1.61 


3 


1st fentry correct 


1 


.73 


.77 - 


• 


2nd Qntry correct . 


1 


. .66 


, .69 




3rd entry correct 


1 


.60 


.63 




all entries correct 


2 


1.31 


1.38 


4 


correct headings 


1 


■ .86 


.91 




correct entries 


2 ' 


'.1.56 


1.64 




Correct answer 


1 


.60 


.63 ' ' 


5 


used a table 

't _ 


1 


.47 


.50 




evidence of a table 


1 


.64 ' 


.67 




correct headings 


1 


.42 


.44 




no struGjiural error 


1 ' 


.91 


.94 




no executiVe error 


1 


.94 




correct answer 


• 1 


.58 


.61 



See p. 123 for details of the qujz criteria. 
' • Maximum, refers to the total number of points possible on that item. 
For these problems, only the final-answer was examined. . 

• (continued) 
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Table J 2 (Continued) 



Quiz Results: Form B 



Problem No. Criteria Maximum Mean :(N=4Q) Mean (N= 53) 

. ^ ■ /■ * 

■ I ' : — ; 



1(1) 




1- ■ 


. 191 . 


.98 


J(2) 




• 1 


.91 . 


.98 


1(3) 




1 


.90 


. .97 


1(4) 


selected 12 


1 




.95 ■ 




selected 2 ; 


' 1 


«*8&,» 


' . .95 . 




selected 4 


1 


.86 


.92 . 




selected 6 


1 


.87 " 


.94 


Z 


cor^rect entries 


2 


1.58 


1.70 ' 


3 . 


1st entry correct . 


1 


' . 71 •' . 


. .76 


. 


2nd entry correct 


1 ■ ■ 


^ - 68 \- 


.73 




3r,d entry correct 


J 


-67. 


-72 




■ \ 4th entry correct 


, 1 


.69 


?74 




all entries cory^ect 


" 2 


1.30; 


1.40- 


4 


. correct headings 


1 , 


- .87." • 


.94 




correct entries 


1 


r.52'> 


1.63 














correct answer* 

t ■ • ' 


- 1 


.63 


.68 


5 


used a table 


1 . 


.27 


•29 




evidence of a table 


1 


^ .32'/.-- 


■.34 




correct headings 


;1 


.23 , , • 


• .25 




^ no structural error 


1 


" - 


' .91 




. no executive error 


■T- ... 


.78' : 


.76 




correct answer 


1 


'.35. 


. ^38 



See p. 123 for details of the quiz criteria.. /"V 
b , ^ , . 

Maximum, refers to the total number of points 'possible on that item. 

X For these problems, only the f|nal anS,wer was -examined. :\ 



catesorie^.r an of the problems in 'the deck involve completing 
two-category tablis. . " ' • 

, Objective 3 : The fj^obl ems related to thi,s objective also ask the stu- 
- . . dent tp complete a eable but now. the table has three categori es . 
Sixty-seven percent of the students corcekly completed some of 
• entries.. It is interesting that onjy 67 perce^it were able ' 
■ tpvcomplete the- ^bles in the problems related to b^ective three 
. ^"wh^le. 80 percent were. success v^Ut^A to.^tfb--. 

-jecttves two'^nd fpur. - Only ten problems in' the problem deck 
• ask the' student to complete a- table that has three categories. 
Also, otily six percent of the problems attempted were this type'. 
^ It- appears ^that the ability to complete two-category tables does 
— ^ iwt'neqessar'il^inake -one effiltfve-at coinixletlfig three-category ! ° 
tables. The teachers that have fifth- and sixth-grade students 
• remarked that ' the fifth-graders had. more" difficulty compYeting , ^ 
the 'three-category tabl es than the sixth-graders. This remark ' 
is not ..supported by the quiz results stnce approximately 67 per- / 
, 'cent- at each grade- level correctly completed the tables. It ■ ' 
is important to note that the objective of completing three-; .* * 
\. category tables was not art objective o'f the module but" was included 
''•y ^y^^*'**<o"-staff as .an objective to.be , measured by the - . ■ 
. qMlz sl^ce several problems In the problem -deck involve^^t^^^ - 

' ■ * ■ * \ . ■ ■ ■ * V • ■■, . 

category taMes.' , . 

I ■ ■ _ ■. 'J ^ • - ■; ■ ■ ■ . ' / 

Objectfve 4 ; One of the criteria established for the pi^i'b^^^ related 
. to this objective Was the same as thjt diacussed. for oMectL 
two; thdt -is, "the student. Will correctl-y complete'ijjb 
#.erttr1es.« The results related/to thfs criterion are 
above. The additional. criteria for these problems on l^fie quiz 

148' '■" ' ' ' ' ^ 
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were that the students woyld (a) enter acceptable titles for the - ' 
cat^gpries, and (b) ob'taiiv the correct answer to'the question(s), 
^ Neaj^ly - 100 percent were able to identify appropriate headings* for 
• the tables. The ^problems related to objective five also required' ' 
; •the. studeht to enter titles for the c/Ctegories in the tables, "In 
the problems related to objective five, nearly 90 pprcer^t., entered 
acceptable titles. Only threfe problems in the booklet and 15 (105S) ' 
problems in the deck require the student to ^select, titles for the 
cate^gq-ries. It appears that even though the 'module does notNpro- 
vide a great deal, of practice at identifying titles, the students 
.were -successful a^t this task with, the problems related to ob- ^ 
jectlves four and five. ■ " ^ 

When the' correct answer is used* as the criterion, 66 percent 
^ of ^tWe sixth-graders ^ and 62 percent' of^ the fiftH-graders correctly ./ 
, ^Ived th^ problem, RecalT that the data on problem card seVfeCr ^ 

; tions shows that the. problems where t+ie student is asked to answer 

. _ • • ■ ■ ■ ■.' • , . - - - • 

. a question using"^^ table (types B and S primarily) were rated fltore • 
difficult than the problems where they are not asked a question. 
Objective 5 : For; the problems related to t^i's objective the students 
- were not given the framework for a table nor were they told to 
us^e a table to solve, the problem. Table 13 shows that 39 percent 
• of the students used a table to obtain an answer while 27 percent 
. used a table to get a correct answer. Sixty-nine percent of those 
that did use a' table did get the correct answer whiMe only 36 per- 
cent of those who di'd not use, a table found the correct solution . 

Most of the c^frs^eT^scb^ when the criterion is 

the correct^^answer.* 

* This, of coarse, may be due to the dil'ficulty of the problems on 
the quiz. . ♦ - . - 



Teacher 24 is Audentspe^^^^^^^^ cqnsid^9ra"b1y/higher than the athe, 
classes,.- This teacher did; not recerf the problem -card selections 
but;didTepoXt $hat the students useVthe cards twici a week for 
- three. weeks: Te^acher 24's implementatton procedures f or ^ book- 
let and the students' charactey5iics Ve.g.._abti levels, socio 
ecdnomic bactgfound) were simi^lar to the other teachers and as a. 
result do, not^ppear to be thevreason for sudh.a high performance. 
. Although Qnly-49 percent of the' sty4erfs obtained the iorrect 
sQlution to^ the two problems' related -to objective fJve. '%he per- ' 
formance on problem, fjve on forfti A was con si drably higher than 
the. performance Dn problem five oh form B. 60 percent versus -37 " 
percent (he Table 12). A^sb.. 49 perceht^of the. students' used a • 

^table to solve problem fiveVforjn a; whil^ only 28 patent used aV 
table on form B.' - . - • ' ' \ , • 



Mean 



, . \ Table; 13 

^ Percent of Students Th^t Used Tables for ^t he 
Problems Related. to Objective Five 




Number 
• , . of 
ade Students 



Used 
Table^ 



y.^ Used a Table ^ . 

and got the . raifative' Corre 
- Right Ajiswer • Percent^ Answe 



6 
6 



28 : 60(44, le/' 
-28 ' 8(8^.0) 

-25 ■■44(^8.16). 
3 0 . , 29 (23 is)' 

• 27 . 44^37.7) ; ' 

26 ;/9(13.l'6) ; 

32 ♦ 60(3^,28) 



.36(32,4), 
\ 4(4. Oj 
36(2^2), 
12(6.6) ' 
216(22"^4) 
17.(13,4)- 
55(-32,23) 



66(.ff.25)"' ''40(32. 

50(50. or) 36(20. 

.82(86.75)' -52 (-28. 
: fl(26.100) ■ 45(32. 

59(59.57) . .41(26. 

59 (100. 25), •46(38il 
^92(10Cr.82) '*Bl(39.i 



39(26.13) , 2>(19,^) .69(23,6'2) .49(31.1 



Percent who. used a table and got the right answer divided by ihe 

percent who used a«-table. • ■ . ^ 

The first 'number jndicaties' the percent for form A and the second * 

number the percent for. form ,B. • 



r 
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i^i- Sumnary - objectives one through .f-1ve ." For the fifth- 

and Sixth-grade students in this field test, nearly every student was 

able to read a table.- Most students (80%) were able to generate some 

entries in two-category tables. Fewer students (67%) were, able to 

generate some entries in three-category tables. The students in most 

cases were able to identify appropriate headings for a table. Approx^ 

imately 50 percent of the students obtained a cocrect- solution to 

ihe problems related to' objectives four and five; however,' the per- 
^^"^"^ ' •■ -■ ■ " "i ' S \ ■ • 

formance was consideraijly higher on formjA (60%) th^n on form B (37%). 

iv. Further analyses . Two additional analyses are possible- 
with the quiz results. First, the. data provided by three teachers 
with respect to pr6blem card selections wii| be examined for a relation 
ship^ between the number of cards that were attempted and the perfor- 
mance on the quiz. Next, one teacher's cla&s^was administered the"^ 
module quiz without having any experiences with the problem deck, 
Thisxlass's quiz Results will be compared to the mean scores for all ' 
the students, ' ^ \ . - ^ 

Table 8 ort page 131 shows the number of problems attempted for 

three^tearchers; The students in class 29 attempted 580 problems 

• ' ' ' / ^ 

while 415 and 379 were attempted ift the others. Table 14 shows that 

. I) - ■ h - . . / 

the perfomj^ince of class 29 was greater than or equal to both of the 
other classes for five of the eight categories. Since most of the 
problems in the deck ask the student to complete tw(/-category table^ 
and'cTa>s^29 attempted the nrast problems in the deck, it follows that* 
class 29 attempted more prot^ems of this type. Problem number two 



class i 
difks tf 



a/k6 the student to complete a two -cart ego.ry. table and Table 14 shows 

•fc. ■ ■ ■ 

that class 29 performed considerably higher than the others. This 
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. Table 14 ' 

Quiz Results on the First Four 
Problems for Three Teachers 



Teacher 






Problem Number 








1(1-3)^ " 


1(A4)'' 


1(B4) , 




"3 


4A^ 


4B 


4C 


29' 


99 


ICQ 


87 


. 82 




84\ 


67 


'52 


28 


92 


92 , 


90 


64 


52 


80 


68 


52 


08 


89 


92 


83 - 


64 


58 


96 


74 


52 



Entries in this column represent the mean percent of correct 
answers for problem 1, p&rt 1-3, on both forms. 

1(A4) and 1(B4) indicate the" 4th part of number 1, forms A ar>d 
B respectively. ' 



4A - Acceptable titles were entered. 
. 4B - Some entries were correctly- completed. > 
4C - correct solution 

trend was not present in problem four (4B); howeveny^ tlie performance 
?cores for all three groups are nearly the same. When the coVrect 
solution is the criterion, class 29 performed equally well for problem 
number four. Also., Table 13 shows that class^29 had a higher percent- '"^ 
age of correct solutions than classes 28 and .08 on problems five. 'The 
evidence in Tables 13 and 14 shows that for these three teachers the" 
class that attempted, mdre problems in the deck generally performed 
higher than the other two! For the eight categories in Table 14 it 
is interesting that the scores for class ?9 are higher* than th6 mean 
scores for all students on only three categories. Glass 29 is primarily 
a fifth-grade class and classes 28 and 08 are completely fifth grade. 
The grand means were calculated with fifth- and sixth-grade classes and 
the sixth-graders generally scored higher than the fiftl>-graders, es- 
V^ecially the sixth- graders >i cljss 24. Therefore, it appears that 
^among the ftfth-grader.s., the students that attempted the most problems 
-in the deck generally performed higher' than the students that attempted 

152 ■ •/ 
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fewer problems. Class 05 contains fifth-graders and generally per- " ^ 
. formed higher than elass 29. However, onV approximately 30 percent 
V of the students in class 05 are fifth-graders while o^ver 50 percent 
are fifth-^graders in class 29. 

. Teacher 09 was ill for an extended period of time. As a result, the f 
students in his class did not work at all with the problem deck*, before 
•the module quiz was administered. Table 15 shows that, the mean per- 
formance of the students in class 09 was higher than^tiie mean for all 
studehts on seven of the eight categories*. However, when the students 

in class 09 are compatred to other sixth-graders (Table 16), the mean ^ 
performance is higher on only three of the categories and by only one 
percentage point in each. For the categories in which the mean )or the 
students in cla^ 09 is less than the mean fop all sixth-graders, the 
mean difference .i? six percentage poil)ts. Therfefofe it appears that 
among the sixth- graders, those students that attempted the problems in 
. the deck generally performed higher than those students who did hot 
attempt any of the problems . 



Table 15 



Quiz Results for One Teacher Who Did 
Not Work with the Problem Deck 









' Problem Nuiiiber 










Teacher ' 


1(1-3)^ 


1(A4)^ 


1(B4) 


2 


. 3 

i 


4A'^ 


4B 


4C 


09 .■■ 


'99 


TOO , 


98 


94 ■ 


81 


92 


81 


63 


Grand 
Mean 
for ' 
Teachers 


93 


\ 


' 9\ 


81 


67 


90 


79 


64 



Entries in this column represent the mean percent of correct 
answers for problem 1, part 1-3, on both forms. 

1(A4) and 1(B4) indicate the 4th part of number 1, forms A and 
B respectively. " , \ • ♦ *r 



4A - Acceptable 'titled were enterod. /'^^ 
is - Some entries were correc^feiy iJ0irtpTe^. 
4C - correct* solution " ' - vS;. . 



Table 16 

Quiz Results for Classes wit 
Sixth-Grade Students -m 




^- Summary of effectiveness. • This ^^J^MoJ^^th^-'evaluation 
was primarily concerned with .the stildents' perfoMcdkn the module 
quiz. It is, important to mention again that this module is part one 
of a two-module sequence. Some of the comments below might no longer ' 
apply if the second half of the sequence were developed. 

1. There is some evidence to . suggest that the module may .have had a 
positive effect on'many areas (e.g., attitudes, ability, to solvd 

. problems using tables,- etc. ) (see p. 139).' 

2. "Reading table^" may not be a new skill for the fifth- and sixth- 
graders (see p. 140). , - 

3. Most, students were aNe to complete some entries in the two- 
-ca^e^ory tables. The three-category tables were more difficult. 

4. Most students w^reable to identify appropriate titles for the 
categories ,pf( a table. , 

5. Most^students did iiot use a table to solve problems when thq use 
of a table was not sugges'ted:* However, the percentage of students 

* "use of a table" was determined by examining students' work"on 
tne quu. It IS possible that students used tables but did not 
draw the table on the qCjiz form. ^ , 
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that obtained the correct solution was higher among the students 
that did use tables than among the students that did not. This 
, suggests that the use of a table did help the students to find the 
correct solutions to* the problemSiOn the quiz. 
6. Ther£ is evidence that at grade five the students that attem|^ed 

the most problems in the* deck performed best on th^quiz. ^Also, 

' ' ' » 

there is^vidence that at^ grade six the students that attempted 
some problems in the deck performed better than the students that 
did not attempt any problems in the deck. This suggests that 
attempting' the problems in the deck'did have a positive effect on 
\ the performance on the quiz. 
4. SimmAy and R^cbrmzncloutLoyu 

The formative evaluation of Using Tables to Solve Problems was 
conducted under the general desi^ of the formative evaluation given 
in Chapter A. of this report. Data, was collected poncerning the three 
major questions of the. formative evaluations related to the implemen- 
tation, organization and content, and effectiveness of the module. 
This section will summarize the results' of the evaluation related to 
each of the major questions. , 

a. Implementation : 
1. The instructional booklet and the problem decl<\were implemented in 
I a varietv^f ways. Every teacher felt that his/her methods were * • 

appropriate fpr his/her students.' The recommended teaching pro- 
'cedures given. irl the teachers' booklet (see p. 119-120) appear to be 
one method for using the module. The teacher's booklet should list 
several of the methods that ^have been used to implement the module. 



" ■ " . .. ■ 

2. It appears that the booklet canbe used in six days (oneday per. 

lesson) with most fifth- and sixth-grade students. Lessons 2 and 
> 3 should be shortened. The problem aeck was used for approximately 
three weeks prior to administering the module quiz. All classes, 
however, did not spend the same amount of time with the problem 
deck dur.ing the three weeks. Al^ough the teachers stated they 
could have used more time with,the^^cJ<, they felt that their pro- 
cedures for implementing the problem deck for three weeks 'were 
adequate preparation for the quiz. The teacher's booklet does not 
identify a recpmended amount of time for the students to work in 
the deck. Even i /There is not a recommended amount of time, some 
discussion of this point should be included in the teacher's 
booklet.* ' . . ■ . _ 

3. Most of the students were allowed to select their own cards from 
the deck. Three teachers reported the" card selections with 580, 
' 415, and 379 problems attempted in these classes. The results 

^ on the module quiz show that 'the class that attempted the most 
problems generally performed better oh the quiz. The module devel- 
opers have not identified a number of problems that should be 
attempted at each difficulty levej. by students of different ability 
leve]^. -Even if such a number J s not td;be identified, s'ome' dis- 
cussion should be^provided related to the findings of this evalua- 

. tton concerning the'reTationship between performance and problem 
card selections.* 
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This issue, is discussed in the revised teacher'^s module developed 
as a result of this report. 



4. The "introductory" nature of this module and the role of "tabUs" 
in mathematical problem solving should be discussed in the teacher 
bo6klet. 

5. The teachers had difficulty identifying the variety of ways one 
' can generate the entries in the tables. If teachers are to use; 

^ this module without the aid of in-service education, the teacher's 
r notes should provide a detailed presentation- of the mathematics in 
the module. 

.6. The dijsttrictions between all the problem types should be discussed 
in the teacher's booklet. 

7. Specific organization and content recommendations are included in 
the section titled"Organization and Content" and in Appendix D. 

' c. Effectiveness : The section related to the "effectiveness" 
of this module was primarily concerned with the. students', performance 
on the module quiz. The following comments are related to the effec- 
tiveness Of the module. 

8. Most students were able to complete some entries in the two- 
category tables^ The' three-category tables were more difficult. 

9. Most students did not. use a' tabl e "(i .e. , draw a table) to solve 
a pfoblem^when the use of a table was not suggested. The quiz 
results indicate that the percent of students that obtained the 

• correct solution.w^s higher among the,--%feu<ient,s that did use tables 
than among the students that ^id not.' 

The teacher feedback and the results of the module quiz provide 
evidence of the "introductory" nature of the objectives of this module. 
The development of the second part of this module would be a real 
contribution to its potential effectiveness. - 
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